2024-01-24T15:11:00.422 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f 2024-01-24T15:11:00.422 DEBUG:teuthology.run:Teuthology command: teuthology --name vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/iozone}} --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530905 --verbose -- /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530905/orig.config.yaml 2024-01-24T15:11:00.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T15:11:00.568 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530905 branch: wip-vshankar-testing1-reef-2024-01-24-1150 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/iozone}} email: vshankar@redhat.com first_in_suite: false job_id: '7530905' kernel: flavor: default kdb: true sha1: f2d3460408951339ac0933340ad449487c9efddc last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-vshankar-testing1-reef-2024-01-24-1150 ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 4e3182a65800aed6d4aa2f6b86da3cfd72188134 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: 4e3182a65800aed6d4aa2f6b86da3cfd72188134 kclient: client.0: mount_subvol_num: 1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing1-reef-2024-01-24-1150 sha1: 4e3182a65800aed6d4aa2f6b86da3cfd72188134 owner: scheduled_vshankar@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 4668 sha1: 4e3182a65800aed6d4aa2f6b86da3cfd72188134 sleep_before_teardown: 0 subset: 346/1024 suite: fs suite_branch: wip-vshankar-testing1-reef-2024-01-24-1150 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 4e3182a65800aed6d4aa2f6b86da3cfd72188134 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFnYjpS9mzlWrQJB5X9LUdt6fHFWI0Wqr4xnsFeYiawvFhmFwzwv3ALfolLmPaXjcIubJfSMygtgHzLtUKmHfbc= smithi160.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHS9eeKoAXq4RAOQUASjdxz1mWjwX51DLEPSv41PitnHqeNFaUUHlJo+2FqmsazRwxn1hBVXhrJnNOYRXx5Aefo= smithi204.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDWmqv2IpSh/vSoK0ySHtqk8o1weSlsIjAPa+Lq4Xy6lUK+TVU0R7QFvxLwN+7mm0NdfwcV+/umoZWMCkgq+QBw= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - suites/iozone.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: c856e0f9244dd29a50697123b480d63f16a4ed81 timestamp: 2024-01-24_12:12:30 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-24T15:11:00.568 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa; will attempt to use it 2024-01-24T15:11:00.569 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks 2024-01-24T15:11:00.569 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-24T15:11:00.570 INFO:teuthology.task.internal:Checking packages... 2024-01-24T15:11:00.593 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '4e3182a65800aed6d4aa2f6b86da3cfd72188134' 2024-01-24T15:11:00.593 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-24T15:11:00.594 INFO:teuthology.packaging:ref: None 2024-01-24T15:11:00.594 INFO:teuthology.packaging:tag: None 2024-01-24T15:11:00.594 INFO:teuthology.packaging:branch: wip-vshankar-testing1-reef-2024-01-24-1150 2024-01-24T15:11:00.594 INFO:teuthology.packaging:sha1: 4e3182a65800aed6d4aa2f6b86da3cfd72188134 2024-01-24T15:11:00.594 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing1-reef-2024-01-24-1150 2024-01-24T15:11:00.737 INFO:teuthology.task.internal:Found packages for ceph version 18.2.1-341.g4e3182a6 2024-01-24T15:11:00.739 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-24T15:11:00.746 INFO:teuthology.task.internal:no buildpackages task found 2024-01-24T15:11:00.746 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-24T15:11:00.763 INFO:teuthology.task.internal:Saving configuration 2024-01-24T15:11:00.784 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-24T15:11:00.790 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-24T15:11:00.814 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530905', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 15:05:38.985061', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFnYjpS9mzlWrQJB5X9LUdt6fHFWI0Wqr4xnsFeYiawvFhmFwzwv3ALfolLmPaXjcIubJfSMygtgHzLtUKmHfbc='} 2024-01-24T15:11:00.835 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530905', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 15:05:38.981839', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHS9eeKoAXq4RAOQUASjdxz1mWjwX51DLEPSv41PitnHqeNFaUUHlJo+2FqmsazRwxn1hBVXhrJnNOYRXx5Aefo='} 2024-01-24T15:11:00.859 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530905', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 15:05:38.983726', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDWmqv2IpSh/vSoK0ySHtqk8o1weSlsIjAPa+Lq4Xy6lUK+TVU0R7QFvxLwN+7mm0NdfwcV+/umoZWMCkgq+QBw='} 2024-01-24T15:11:00.859 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-24T15:11:00.865 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-01-24T15:11:00.865 INFO:teuthology.task.internal:roles: ubuntu@smithi160.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-01-24T15:11:00.865 INFO:teuthology.task.internal:roles: ubuntu@smithi204.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-01-24T15:11:00.865 INFO:teuthology.run_tasks:Running task console_log... 2024-01-24T15:11:00.967 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f61d3f870d0>, signals=[15]) 2024-01-24T15:11:00.968 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-24T15:11:00.974 INFO:teuthology.task.internal:Opening connections... 2024-01-24T15:11:00.974 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2024-01-24T15:11:00.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T15:11:01.053 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi160.front.sepia.ceph.com 2024-01-24T15:11:01.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T15:11:01.127 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi204.front.sepia.ceph.com 2024-01-24T15:11:01.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T15:11:01.200 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-24T15:11:01.207 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-01-24T15:11:01.230 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-01-24T15:11:01.230 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-01-24T15:11:01.291 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Red Hat Enterprise Linux" 2024-01-24T15:11:01.291 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8.6 (Ootpa)" 2024-01-24T15:11:01.291 INFO:teuthology.orchestra.run.smithi005.stdout:ID="rhel" 2024-01-24T15:11:01.291 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="fedora" 2024-01-24T15:11:01.291 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8.6" 2024-01-24T15:11:01.291 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8" 2024-01-24T15:11:01.291 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-24T15:11:01.291 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-01-24T15:11:01.291 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-24T15:11:01.291 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.redhat.com/" 2024-01-24T15:11:01.292 INFO:teuthology.orchestra.run.smithi005.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-24T15:11:01.292 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-24T15:11:01.292 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:11:01.292 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-24T15:11:01.292 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-24T15:11:01.292 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-24T15:11:01.292 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-24T15:11:01.293 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-01-24T15:11:01.320 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2024-01-24T15:11:01.341 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2024-01-24T15:11:01.341 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2024-01-24T15:11:01.404 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Red Hat Enterprise Linux" 2024-01-24T15:11:01.404 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8.6 (Ootpa)" 2024-01-24T15:11:01.404 INFO:teuthology.orchestra.run.smithi160.stdout:ID="rhel" 2024-01-24T15:11:01.404 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="fedora" 2024-01-24T15:11:01.404 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8.6" 2024-01-24T15:11:01.404 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8" 2024-01-24T15:11:01.405 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-24T15:11:01.405 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2024-01-24T15:11:01.405 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-24T15:11:01.405 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.redhat.com/" 2024-01-24T15:11:01.405 INFO:teuthology.orchestra.run.smithi160.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-24T15:11:01.405 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-24T15:11:01.405 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-01-24T15:11:01.406 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-24T15:11:01.406 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-24T15:11:01.406 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-24T15:11:01.406 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-24T15:11:01.406 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2024-01-24T15:11:01.444 DEBUG:teuthology.orchestra.run.smithi204:> uname -m 2024-01-24T15:11:01.465 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2024-01-24T15:11:01.466 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2024-01-24T15:11:01.525 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="Red Hat Enterprise Linux" 2024-01-24T15:11:01.526 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="8.6 (Ootpa)" 2024-01-24T15:11:01.526 INFO:teuthology.orchestra.run.smithi204.stdout:ID="rhel" 2024-01-24T15:11:01.526 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="fedora" 2024-01-24T15:11:01.526 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="8.6" 2024-01-24T15:11:01.526 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el8" 2024-01-24T15:11:01.526 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-24T15:11:01.526 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2024-01-24T15:11:01.526 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-24T15:11:01.526 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://www.redhat.com/" 2024-01-24T15:11:01.526 INFO:teuthology.orchestra.run.smithi204.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-24T15:11:01.526 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-24T15:11:01.526 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-01-24T15:11:01.526 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-24T15:11:01.527 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-24T15:11:01.527 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-24T15:11:01.527 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-24T15:11:01.527 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2024-01-24T15:11:01.552 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-24T15:11:01.562 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-24T15:11:01.567 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-24T15:11:01.568 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2024-01-24T15:11:01.570 DEBUG:teuthology.orchestra.run.smithi160:> test '!' -e /home/ubuntu/cephtest 2024-01-24T15:11:01.572 DEBUG:teuthology.orchestra.run.smithi204:> test '!' -e /home/ubuntu/cephtest 2024-01-24T15:11:01.591 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-24T15:11:01.597 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-24T15:11:01.597 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2024-01-24T15:11:01.631 DEBUG:teuthology.orchestra.run.smithi160:> test -z $(ls -A /var/lib/ceph) 2024-01-24T15:11:01.636 DEBUG:teuthology.orchestra.run.smithi204:> test -z $(ls -A /var/lib/ceph) 2024-01-24T15:11:01.680 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-24T15:11:01.753 INFO:teuthology.run_tasks:Running task kernel... 2024-01-24T15:11:01.768 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'f2d3460408951339ac0933340ad449487c9efddc'} 2024-01-24T15:11:01.768 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'f2d3460408951339ac0933340ad449487c9efddc'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'f2d3460408951339ac0933340ad449487c9efddc'}, 'mon.c': {'flavor': 'default', 'kdb': True, 'sha1': 'f2d3460408951339ac0933340ad449487c9efddc'}}, timeout 300 2024-01-24T15:11:01.768 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-24T15:11:01.769 DEBUG:teuthology.orchestra.run.smithi160:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-24T15:11:01.769 DEBUG:teuthology.orchestra.run.smithi204:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-24T15:11:01.788 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T15:11:01.788 DEBUG:teuthology.task.kernel:sha1 for mon.c is f2d3460408951339ac0933340ad449487c9efddc 2024-01-24T15:11:01.788 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "f2d3460408951339ac0933340ad449487c9efddc"... 2024-01-24T15:11:01.789 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2024-01-24T15:11:01.790 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T15:11:01.790 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T15:11:01.790 DEBUG:teuthology.task.kernel:sha1 for mon.a is f2d3460408951339ac0933340ad449487c9efddc 2024-01-24T15:11:01.790 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "f2d3460408951339ac0933340ad449487c9efddc"... 2024-01-24T15:11:01.790 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-01-24T15:11:01.791 DEBUG:teuthology.task.kernel:sha1 for mon.b is f2d3460408951339ac0933340ad449487c9efddc 2024-01-24T15:11:01.791 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "f2d3460408951339ac0933340ad449487c9efddc"... 2024-01-24T15:11:01.791 DEBUG:teuthology.orchestra.run.smithi160:> uname -r 2024-01-24T15:11:01.846 INFO:teuthology.orchestra.run.smithi204.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-01-24T15:11:01.847 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-513.9.1.el8_9.x86_64 vs f2d3460408951339ac0933340ad449487c9efddc 2024-01-24T15:11:01.847 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-24T15:11:01.847 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f2d3460408951339ac0933340ad449487c9efddc 2024-01-24T15:11:01.851 INFO:teuthology.orchestra.run.smithi005.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-01-24T15:11:01.851 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-513.9.1.el8_9.x86_64 vs f2d3460408951339ac0933340ad449487c9efddc 2024-01-24T15:11:01.851 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-24T15:11:01.852 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f2d3460408951339ac0933340ad449487c9efddc 2024-01-24T15:11:01.855 INFO:teuthology.orchestra.run.smithi160.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-01-24T15:11:01.855 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-513.9.1.el8_9.x86_64 vs f2d3460408951339ac0933340ad449487c9efddc 2024-01-24T15:11:01.855 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-24T15:11:01.855 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f2d3460408951339ac0933340ad449487c9efddc 2024-01-24T15:11:01.992 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum upgrade -y linux-firmware 2024-01-24T15:11:02.066 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum upgrade -y linux-firmware 2024-01-24T15:11:02.073 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum upgrade -y linux-firmware 2024-01-24T15:11:03.578 INFO:teuthology.orchestra.run.smithi204.stdout:Updating Subscription Management repositories. 2024-01-24T15:11:03.578 INFO:teuthology.orchestra.run.smithi204.stdout:Unable to read consumer identity 2024-01-24T15:11:03.635 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2024-01-24T15:11:03.635 INFO:teuthology.orchestra.run.smithi005.stdout:Unable to read consumer identity 2024-01-24T15:11:03.636 INFO:teuthology.orchestra.run.smithi160.stdout:Updating Subscription Management repositories. 2024-01-24T15:11:03.636 INFO:teuthology.orchestra.run.smithi160.stdout:Unable to read consumer identity 2024-01-24T15:11:03.888 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-01-24T15:11:03.888 INFO:teuthology.orchestra.run.smithi204.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-01-24T15:11:03.888 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-01-24T15:11:03.947 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-01-24T15:11:03.947 INFO:teuthology.orchestra.run.smithi160.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-01-24T15:11:03.947 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-01-24T15:11:03.959 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:11:03.959 INFO:teuthology.orchestra.run.smithi005.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-01-24T15:11:03.959 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:11:05.734 INFO:teuthology.orchestra.run.smithi005.stdout:Copr repo for python3-asyncssh owned by ceph 15 kB/s | 3.5 kB 00:00 2024-01-24T15:11:05.736 INFO:teuthology.orchestra.run.smithi160.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2024-01-24T15:11:05.799 INFO:teuthology.orchestra.run.smithi204.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2024-01-24T15:11:06.651 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2024-01-24T15:11:07.297 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2024-01-24T15:11:09.933 INFO:teuthology.orchestra.run.smithi204.stdout:Extra Packages for Enterprise Linux 3.8 MB/s | 16 MB 00:04 2024-01-24T15:11:10.660 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 473 kB/s | 24 kB 00:00 2024-01-24T15:11:10.862 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 571 kB/s | 24 kB 00:00 2024-01-24T15:11:11.526 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-01-24T15:11:11.527 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-01-24T15:11:11.527 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-01-24T15:11:11.705 INFO:teuthology.task.kernel:Downloading kernel f2d3460408951339ac0933340ad449487c9efddc on mon.a... 2024-01-24T15:11:11.705 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f2d3460408951339ac0933340ad449487c9efddc 2024-01-24T15:11:11.742 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-01-24T15:11:11.743 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-01-24T15:11:11.743 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-01-24T15:11:11.891 INFO:teuthology.task.kernel:Downloading kernel f2d3460408951339ac0933340ad449487c9efddc on mon.b... 2024-01-24T15:11:11.891 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f2d3460408951339ac0933340ad449487c9efddc 2024-01-24T15:11:11.924 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/f2d3460408951339ac0933340ad449487c9efddc/centos/8/flavors/default/x86_64/ 2024-01-24T15:11:11.925 DEBUG:teuthology.orchestra.run.smithi005:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.7.0_gf2d346040895-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/f2d3460408951339ac0933340ad449487c9efddc/centos/8/flavors/default/x86_64/ --input-file=- 2024-01-24T15:11:11.927 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi005.front.sepia.ceph.com to complete... 2024-01-24T15:11:12.105 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/f2d3460408951339ac0933340ad449487c9efddc/centos/8/flavors/default/x86_64/ 2024-01-24T15:11:12.105 DEBUG:teuthology.orchestra.run.smithi160:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.7.0_gf2d346040895-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/f2d3460408951339ac0933340ad449487c9efddc/centos/8/flavors/default/x86_64/ --input-file=- 2024-01-24T15:11:12.107 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi160.front.sepia.ceph.com to complete... 2024-01-24T15:11:13.550 INFO:teuthology.orchestra.run.smithi204.stdout:lab-extras 418 kB/s | 24 kB 00:00 2024-01-24T15:11:14.411 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-01-24T15:11:14.412 INFO:teuthology.orchestra.run.smithi204.stdout:Nothing to do. 2024-01-24T15:11:14.412 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-01-24T15:11:14.547 INFO:teuthology.task.kernel:Downloading kernel f2d3460408951339ac0933340ad449487c9efddc on mon.c... 2024-01-24T15:11:14.547 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f2d3460408951339ac0933340ad449487c9efddc 2024-01-24T15:11:14.761 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/f2d3460408951339ac0933340ad449487c9efddc/centos/8/flavors/default/x86_64/ 2024-01-24T15:11:14.761 DEBUG:teuthology.orchestra.run.smithi204:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.7.0_gf2d346040895-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/f2d3460408951339ac0933340ad449487c9efddc/centos/8/flavors/default/x86_64/ --input-file=- 2024-01-24T15:11:14.763 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi204.front.sepia.ceph.com to complete... 2024-01-24T15:11:48.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24 15:11:48 URL:https://2.chacra.ceph.com/r/kernel/testing/f2d3460408951339ac0933340ad449487c9efddc/centos/8/flavors/default/x86_64/kernel-6.7.0_gf2d346040895-1.x86_64.rpm [394673248/394673248] -> "/tmp/kernel.x86_64.rpm" [1] 2024-01-24T15:11:48.692 INFO:teuthology.orchestra.run.smithi005.stderr:FINISHED --2024-01-24 15:11:48-- 2024-01-24T15:11:48.692 INFO:teuthology.orchestra.run.smithi005.stderr:Total wall clock time: 37s 2024-01-24T15:11:48.692 INFO:teuthology.orchestra.run.smithi005.stderr:Downloaded: 1 files, 376M in 37s (10.3 MB/s) 2024-01-24T15:11:48.695 INFO:teuthology.task.kernel:Installing kernel f2d3460408951339ac0933340ad449487c9efddc on mon.a... 2024-01-24T15:11:48.696 DEBUG:teuthology.orchestra.run.smithi005:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-01-24T15:11:50.680 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying... ######################################## 2024-01-24T15:11:50.772 INFO:teuthology.orchestra.run.smithi005.stdout:Preparing... ######################################## 2024-01-24T15:11:50.943 INFO:teuthology.orchestra.run.smithi005.stdout:Updating / installing... 2024-01-24T15:12:11.158 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24 15:12:11 URL:https://2.chacra.ceph.com/r/kernel/testing/f2d3460408951339ac0933340ad449487c9efddc/centos/8/flavors/default/x86_64/kernel-6.7.0_gf2d346040895-1.x86_64.rpm [394673248/394673248] -> "/tmp/kernel.x86_64.rpm" [1] 2024-01-24T15:12:11.158 INFO:teuthology.orchestra.run.smithi204.stderr:FINISHED --2024-01-24 15:12:11-- 2024-01-24T15:12:11.158 INFO:teuthology.orchestra.run.smithi204.stderr:Total wall clock time: 56s 2024-01-24T15:12:11.158 INFO:teuthology.orchestra.run.smithi204.stderr:Downloaded: 1 files, 376M in 56s (6.72 MB/s) 2024-01-24T15:12:11.161 INFO:teuthology.task.kernel:Installing kernel f2d3460408951339ac0933340ad449487c9efddc on mon.c... 2024-01-24T15:12:11.162 DEBUG:teuthology.orchestra.run.smithi204:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-01-24T15:12:12.965 INFO:teuthology.orchestra.run.smithi204.stdout:Verifying... ######################################## 2024-01-24T15:12:13.047 INFO:teuthology.orchestra.run.smithi204.stdout:Preparing... ######################################## 2024-01-24T15:12:13.210 INFO:teuthology.orchestra.run.smithi204.stdout:Updating / installing... 2024-01-24T15:12:21.263 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24 15:12:21 URL:https://2.chacra.ceph.com/r/kernel/testing/f2d3460408951339ac0933340ad449487c9efddc/centos/8/flavors/default/x86_64/kernel-6.7.0_gf2d346040895-1.x86_64.rpm [394673248/394673248] -> "/tmp/kernel.x86_64.rpm" [1] 2024-01-24T15:12:21.264 INFO:teuthology.orchestra.run.smithi160.stderr:FINISHED --2024-01-24 15:12:21-- 2024-01-24T15:12:21.264 INFO:teuthology.orchestra.run.smithi160.stderr:Total wall clock time: 1m 9s 2024-01-24T15:12:21.264 INFO:teuthology.orchestra.run.smithi160.stderr:Downloaded: 1 files, 376M in 1m 9s (5.47 MB/s) 2024-01-24T15:12:21.267 INFO:teuthology.task.kernel:Installing kernel f2d3460408951339ac0933340ad449487c9efddc on mon.b... 2024-01-24T15:12:21.267 DEBUG:teuthology.orchestra.run.smithi160:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-01-24T15:12:23.064 INFO:teuthology.orchestra.run.smithi160.stdout:Verifying... ######################################## 2024-01-24T15:12:23.155 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing... ######################################## 2024-01-24T15:12:23.329 INFO:teuthology.orchestra.run.smithi160.stdout:Updating / installing... 2024-01-24T15:12:34.679 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-6.7.0_gf2d346040895-1 ######################################## 2024-01-24T15:12:36.296 INFO:teuthology.orchestra.run.smithi005.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-24T15:12:52.859 INFO:teuthology.orchestra.run.smithi204.stdout:kernel-6.7.0_gf2d346040895-1 ######################################## 2024-01-24T15:12:58.203 INFO:teuthology.orchestra.run.smithi204.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-24T15:12:59.410 INFO:teuthology.orchestra.run.smithi005.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-24T15:13:03.039 INFO:teuthology.orchestra.run.smithi160.stdout:kernel-6.7.0_gf2d346040895-1 ######################################## 2024-01-24T15:13:04.522 INFO:teuthology.orchestra.run.smithi160.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-24T15:13:17.840 INFO:teuthology.orchestra.run.smithi204.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-24T15:13:26.434 INFO:teuthology.orchestra.run.smithi160.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-24T15:15:16.861 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi005.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-01-24T15:15:16.862 DEBUG:teuthology.orchestra.run.smithi005:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-01-24T15:15:16.922 INFO:teuthology.orchestra.run.smithi005.stdout:/boot/System.map-6.7.0-gf2d346040895 2024-01-24T15:15:16.922 INFO:teuthology.orchestra.run.smithi005.stdout:/boot/config-6.7.0-gf2d346040895 2024-01-24T15:15:16.922 INFO:teuthology.orchestra.run.smithi005.stdout:/boot/vmlinuz-6.7.0-gf2d346040895 2024-01-24T15:15:16.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895 2024-01-24T15:15:16.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel 2024-01-24T15:15:16.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch 2024-01-24T15:15:16.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86 2024-01-24T15:15:16.922 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto 2024-01-24T15:15:16.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-24T15:15:16.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-24T15:15:16.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-24T15:15:16.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-24T15:15:16.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-24T15:15:16.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-24T15:15:16.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-24T15:15:16.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/crc32c-intel.ko 2024-01-24T15:15:16.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-24T15:15:16.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-24T15:15:16.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-24T15:15:16.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-24T15:15:16.923 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-24T15:15:16.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-24T15:15:16.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-24T15:15:16.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-24T15:15:16.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-24T15:15:16.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-24T15:15:16.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-24T15:15:16.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-24T15:15:16.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel 2024-01-24T15:15:16.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/cpu 2024-01-24T15:15:16.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/cpu/mce 2024-01-24T15:15:16.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-24T15:15:16.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kvm 2024-01-24T15:15:16.924 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-24T15:15:16.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-24T15:15:16.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kvm/kvm.ko 2024-01-24T15:15:16.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto 2024-01-24T15:15:16.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/ansi_cprng.ko 2024-01-24T15:15:16.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/anubis.ko 2024-01-24T15:15:16.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/arc4.ko 2024-01-24T15:15:16.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx 2024-01-24T15:15:16.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_memcpy.ko 2024-01-24T15:15:16.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_pq.ko 2024-01-24T15:15:16.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-24T15:15:16.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_tx.ko 2024-01-24T15:15:16.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_xor.ko 2024-01-24T15:15:16.925 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/raid6test.ko 2024-01-24T15:15:16.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/authenc.ko 2024-01-24T15:15:16.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/authencesn.ko 2024-01-24T15:15:16.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/blake2b_generic.ko 2024-01-24T15:15:16.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/blowfish_common.ko 2024-01-24T15:15:16.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/blowfish_generic.ko 2024-01-24T15:15:16.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/camellia_generic.ko 2024-01-24T15:15:16.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/cast5_generic.ko 2024-01-24T15:15:16.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/cast6_generic.ko 2024-01-24T15:15:16.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/cast_common.ko 2024-01-24T15:15:16.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/ccm.ko 2024-01-24T15:15:16.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/cmac.ko 2024-01-24T15:15:16.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/crc32_generic.ko 2024-01-24T15:15:16.926 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/crypto_engine.ko 2024-01-24T15:15:16.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/crypto_user.ko 2024-01-24T15:15:16.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/cts.ko 2024-01-24T15:15:16.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/des_generic.ko 2024-01-24T15:15:16.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/dh_generic.ko 2024-01-24T15:15:16.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/echainiv.ko 2024-01-24T15:15:16.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/essiv.ko 2024-01-24T15:15:16.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/fcrypt.ko 2024-01-24T15:15:16.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/khazad.ko 2024-01-24T15:15:16.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/lz4.ko 2024-01-24T15:15:16.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/lz4hc.ko 2024-01-24T15:15:16.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/md4.ko 2024-01-24T15:15:16.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/michael_mic.ko 2024-01-24T15:15:16.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/pcbc.ko 2024-01-24T15:15:16.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/pcrypt.ko 2024-01-24T15:15:16.927 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/rmd160.ko 2024-01-24T15:15:16.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/seed.ko 2024-01-24T15:15:16.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/serpent_generic.ko 2024-01-24T15:15:16.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/tcrypt.ko 2024-01-24T15:15:16.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/tea.ko 2024-01-24T15:15:16.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/twofish_common.ko 2024-01-24T15:15:16.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/twofish_generic.ko 2024-01-24T15:15:16.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/vmac.ko 2024-01-24T15:15:16.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/wp512.ko 2024-01-24T15:15:16.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/xcbc.ko 2024-01-24T15:15:16.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/xor.ko 2024-01-24T15:15:16.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/xxhash_generic.ko 2024-01-24T15:15:16.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers 2024-01-24T15:15:16.928 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi 2024-01-24T15:15:16.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-24T15:15:16.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/acpi_pad.ko 2024-01-24T15:15:16.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/custom_method.ko 2024-01-24T15:15:16.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/ec_sys.ko 2024-01-24T15:15:16.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/platform_profile.ko 2024-01-24T15:15:16.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/sbs.ko 2024-01-24T15:15:16.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/sbshc.ko 2024-01-24T15:15:16.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/video.ko 2024-01-24T15:15:16.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata 2024-01-24T15:15:16.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/acard-ahci.ko 2024-01-24T15:15:16.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/ahci_platform.ko 2024-01-24T15:15:16.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/ata_generic.ko 2024-01-24T15:15:16.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/libahci_platform.ko 2024-01-24T15:15:16.929 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_acpi.ko 2024-01-24T15:15:16.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_ali.ko 2024-01-24T15:15:16.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_amd.ko 2024-01-24T15:15:16.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_artop.ko 2024-01-24T15:15:16.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_atiixp.ko 2024-01-24T15:15:16.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_atp867x.ko 2024-01-24T15:15:16.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_cmd640.ko 2024-01-24T15:15:16.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_cmd64x.ko 2024-01-24T15:15:16.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_cypress.ko 2024-01-24T15:15:16.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_efar.ko 2024-01-24T15:15:16.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_hpt366.ko 2024-01-24T15:15:16.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_hpt37x.ko 2024-01-24T15:15:16.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-24T15:15:16.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-24T15:15:16.930 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_it8213.ko 2024-01-24T15:15:16.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_it821x.ko 2024-01-24T15:15:16.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_jmicron.ko 2024-01-24T15:15:16.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_marvell.ko 2024-01-24T15:15:16.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_mpiix.ko 2024-01-24T15:15:16.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_netcell.ko 2024-01-24T15:15:16.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_ninja32.ko 2024-01-24T15:15:16.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_ns87410.ko 2024-01-24T15:15:16.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_ns87415.ko 2024-01-24T15:15:16.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_oldpiix.ko 2024-01-24T15:15:16.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_opti.ko 2024-01-24T15:15:16.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_optidma.ko 2024-01-24T15:15:16.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_pcmcia.ko 2024-01-24T15:15:16.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-24T15:15:16.931 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-24T15:15:16.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_piccolo.ko 2024-01-24T15:15:16.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_rdc.ko 2024-01-24T15:15:16.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_sch.ko 2024-01-24T15:15:16.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_serverworks.ko 2024-01-24T15:15:16.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_sil680.ko 2024-01-24T15:15:16.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_sis.ko 2024-01-24T15:15:16.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_sl82c105.ko 2024-01-24T15:15:16.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_triflex.ko 2024-01-24T15:15:16.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_via.ko 2024-01-24T15:15:16.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pdc_adma.ko 2024-01-24T15:15:16.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_inic162x.ko 2024-01-24T15:15:16.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_mv.ko 2024-01-24T15:15:16.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_nv.ko 2024-01-24T15:15:16.932 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_promise.ko 2024-01-24T15:15:16.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_qstor.ko 2024-01-24T15:15:16.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_sil.ko 2024-01-24T15:15:16.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_sil24.ko 2024-01-24T15:15:16.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_sis.ko 2024-01-24T15:15:16.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_svw.ko 2024-01-24T15:15:16.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_sx4.ko 2024-01-24T15:15:16.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_uli.ko 2024-01-24T15:15:16.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_via.ko 2024-01-24T15:15:16.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_vsc.ko 2024-01-24T15:15:16.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/auxdisplay 2024-01-24T15:15:16.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/auxdisplay/ks0108.ko 2024-01-24T15:15:16.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/base 2024-01-24T15:15:16.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/base/regmap 2024-01-24T15:15:16.933 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/base/regmap/regmap-i2c.ko 2024-01-24T15:15:16.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/base/regmap/regmap-mmio.ko 2024-01-24T15:15:16.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/bcma 2024-01-24T15:15:16.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/bcma/bcma.ko 2024-01-24T15:15:16.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block 2024-01-24T15:15:16.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/aoe 2024-01-24T15:15:16.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/aoe/aoe.ko 2024-01-24T15:15:16.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/brd.ko 2024-01-24T15:15:16.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/drbd 2024-01-24T15:15:16.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/drbd/drbd.ko 2024-01-24T15:15:16.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/floppy.ko 2024-01-24T15:15:16.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/loop.ko 2024-01-24T15:15:16.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/mtip32xx 2024-01-24T15:15:16.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-24T15:15:16.934 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/nbd.ko 2024-01-24T15:15:16.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/null_blk 2024-01-24T15:15:16.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/null_blk/null_blk.ko 2024-01-24T15:15:16.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/pktcdvd.ko 2024-01-24T15:15:16.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/rbd.ko 2024-01-24T15:15:16.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/virtio_blk.ko 2024-01-24T15:15:16.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/xen-blkback 2024-01-24T15:15:16.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-24T15:15:16.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/xen-blkfront.ko 2024-01-24T15:15:16.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/zram 2024-01-24T15:15:16.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/zram/zram.ko 2024-01-24T15:15:16.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char 2024-01-24T15:15:16.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hangcheck-timer.ko 2024-01-24T15:15:16.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random 2024-01-24T15:15:16.935 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-24T15:15:16.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-24T15:15:16.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-24T15:15:16.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/via-rng.ko 2024-01-24T15:15:16.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-24T15:15:16.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi 2024-01-24T15:15:16.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-24T15:15:16.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-24T15:15:16.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-24T15:15:16.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-24T15:15:16.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-24T15:15:16.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-24T15:15:16.936 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/lp.ko 2024-01-24T15:15:16.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/mwave 2024-01-24T15:15:16.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/mwave/mwave.ko 2024-01-24T15:15:16.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ppdev.ko 2024-01-24T15:15:16.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tlclk.ko 2024-01-24T15:15:16.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm 2024-01-24T15:15:16.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm.ko 2024-01-24T15:15:16.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-24T15:15:16.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-24T15:15:16.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-24T15:15:16.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_tis.ko 2024-01-24T15:15:16.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-01-24T15:15:16.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/uv_mmtimer.ko 2024-01-24T15:15:16.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/virtio_console.ko 2024-01-24T15:15:16.937 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq 2024-01-24T15:15:16.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-01-24T15:15:16.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-24T15:15:16.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-24T15:15:16.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-01-24T15:15:16.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/powernow-k8.ko 2024-01-24T15:15:16.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-24T15:15:16.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto 2024-01-24T15:15:16.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/ccp 2024-01-24T15:15:16.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-24T15:15:16.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/ccp/ccp.ko 2024-01-24T15:15:16.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel 2024-01-24T15:15:16.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat 2024-01-24T15:15:16.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/qat_common 2024-01-24T15:15:16.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-24T15:15:16.938 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-01-24T15:15:16.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-24T15:15:16.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/padlock-aes.ko 2024-01-24T15:15:16.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/padlock-sha.ko 2024-01-24T15:15:16.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/virtio 2024-01-24T15:15:16.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-24T15:15:16.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/dca 2024-01-24T15:15:16.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/dca/dca.ko 2024-01-24T15:15:16.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/devfreq 2024-01-24T15:15:16.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-01-24T15:15:16.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma 2024-01-24T15:15:16.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/dw 2024-01-24T15:15:16.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-24T15:15:16.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/ioat 2024-01-24T15:15:16.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-24T15:15:16.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac 2024-01-24T15:15:16.939 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/amd64_edac.ko 2024-01-24T15:15:16.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/e752x_edac.ko 2024-01-24T15:15:16.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/edac_mce_amd.ko 2024-01-24T15:15:16.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i3000_edac.ko 2024-01-24T15:15:16.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i3200_edac.ko 2024-01-24T15:15:16.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i5100_edac.ko 2024-01-24T15:15:16.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i5400_edac.ko 2024-01-24T15:15:16.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i7300_edac.ko 2024-01-24T15:15:16.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i7core_edac.ko 2024-01-24T15:15:16.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i82975x_edac.ko 2024-01-24T15:15:16.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/ie31200_edac.ko 2024-01-24T15:15:16.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/sb_edac.ko 2024-01-24T15:15:16.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/x38_edac.ko 2024-01-24T15:15:16.940 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/firmware 2024-01-24T15:15:16.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/firmware/edd.ko 2024-01-24T15:15:16.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-24T15:15:16.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio 2024-01-24T15:15:16.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-ich.ko 2024-01-24T15:15:16.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-24T15:15:16.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid 2024-01-24T15:15:16.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-appleir.ko 2024-01-24T15:15:16.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-aureal.ko 2024-01-24T15:15:16.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-axff.ko 2024-01-24T15:15:16.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-dr.ko 2024-01-24T15:15:16.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-elecom.ko 2024-01-24T15:15:16.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-elo.ko 2024-01-24T15:15:16.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-emsff.ko 2024-01-24T15:15:16.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-gaff.ko 2024-01-24T15:15:16.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-gt683r.ko 2024-01-24T15:15:16.941 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-gyration.ko 2024-01-24T15:15:16.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-24T15:15:16.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-24T15:15:16.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-holtekff.ko 2024-01-24T15:15:16.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-hyperv.ko 2024-01-24T15:15:16.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-icade.ko 2024-01-24T15:15:16.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-keytouch.ko 2024-01-24T15:15:16.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-kye.ko 2024-01-24T15:15:16.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-lcpower.ko 2024-01-24T15:15:16.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-led.ko 2024-01-24T15:15:16.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-lenovo.ko 2024-01-24T15:15:16.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-24T15:15:16.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-24T15:15:16.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-multitouch.ko 2024-01-24T15:15:16.942 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-ortek.ko 2024-01-24T15:15:16.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-penmount.ko 2024-01-24T15:15:16.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-petalynx.ko 2024-01-24T15:15:16.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-picolcd.ko 2024-01-24T15:15:16.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-pl.ko 2024-01-24T15:15:16.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-plantronics.ko 2024-01-24T15:15:16.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-primax.ko 2024-01-24T15:15:16.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-rmi.ko 2024-01-24T15:15:16.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-24T15:15:16.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-common.ko 2024-01-24T15:15:16.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-24T15:15:16.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-24T15:15:16.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-24T15:15:16.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-24T15:15:16.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-24T15:15:16.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-24T15:15:16.943 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-24T15:15:16.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-24T15:15:16.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-24T15:15:16.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat.ko 2024-01-24T15:15:16.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-saitek.ko 2024-01-24T15:15:16.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-samsung.ko 2024-01-24T15:15:16.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-24T15:15:16.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-sjoy.ko 2024-01-24T15:15:16.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-sony.ko 2024-01-24T15:15:16.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-speedlink.ko 2024-01-24T15:15:16.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-steelseries.ko 2024-01-24T15:15:16.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-sunplus.ko 2024-01-24T15:15:16.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-24T15:15:16.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-tivo.ko 2024-01-24T15:15:16.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-tmff.ko 2024-01-24T15:15:16.944 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-topseed.ko 2024-01-24T15:15:16.945 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-twinhan.ko 2024-01-24T15:15:16.945 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-uclogic.ko 2024-01-24T15:15:16.945 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-waltop.ko 2024-01-24T15:15:16.945 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-wiimote.ko 2024-01-24T15:15:16.945 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-xinmo.ko 2024-01-24T15:15:16.945 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-zpff.ko 2024-01-24T15:15:16.945 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-zydacron.ko 2024-01-24T15:15:16.945 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/uhid.ko 2024-01-24T15:15:16.945 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/wacom.ko 2024-01-24T15:15:16.945 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hv 2024-01-24T15:15:16.945 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hv/hv_balloon.ko 2024-01-24T15:15:16.945 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hv/hv_utils.ko 2024-01-24T15:15:16.945 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hv/hv_vmbus.ko 2024-01-24T15:15:16.945 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon 2024-01-24T15:15:16.945 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/abituguru.ko 2024-01-24T15:15:16.945 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/abituguru3.ko 2024-01-24T15:15:16.945 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-24T15:15:16.946 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ad7414.ko 2024-01-24T15:15:16.946 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ad7418.ko 2024-01-24T15:15:16.946 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adc128d818.ko 2024-01-24T15:15:16.946 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm1025.ko 2024-01-24T15:15:16.946 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm1026.ko 2024-01-24T15:15:16.946 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm1029.ko 2024-01-24T15:15:16.946 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm1031.ko 2024-01-24T15:15:16.946 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm9240.ko 2024-01-24T15:15:16.946 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ads7828.ko 2024-01-24T15:15:16.946 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7410.ko 2024-01-24T15:15:16.946 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7411.ko 2024-01-24T15:15:16.946 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7462.ko 2024-01-24T15:15:16.946 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7470.ko 2024-01-24T15:15:16.946 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7475.ko 2024-01-24T15:15:16.946 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7x10.ko 2024-01-24T15:15:16.946 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/amc6821.ko 2024-01-24T15:15:16.947 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/applesmc.ko 2024-01-24T15:15:16.947 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/asb100.ko 2024-01-24T15:15:16.947 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/asc7621.ko 2024-01-24T15:15:16.947 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-24T15:15:16.947 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/atxp1.ko 2024-01-24T15:15:16.947 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/coretemp.ko 2024-01-24T15:15:16.947 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-24T15:15:16.947 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/dme1737.ko 2024-01-24T15:15:16.947 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ds1621.ko 2024-01-24T15:15:16.947 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ds620.ko 2024-01-24T15:15:16.947 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/emc1403.ko 2024-01-24T15:15:16.947 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/emc6w201.ko 2024-01-24T15:15:16.947 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/f71805f.ko 2024-01-24T15:15:16.947 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/f71882fg.ko 2024-01-24T15:15:16.947 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/f75375s.ko 2024-01-24T15:15:16.947 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/fam15h_power.ko 2024-01-24T15:15:16.948 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/fschmd.ko 2024-01-24T15:15:16.948 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/g760a.ko 2024-01-24T15:15:16.948 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/g762.ko 2024-01-24T15:15:16.948 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/gl518sm.ko 2024-01-24T15:15:16.948 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/gl520sm.ko 2024-01-24T15:15:16.948 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-24T15:15:16.948 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/i5500_temp.ko 2024-01-24T15:15:16.948 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/i5k_amb.ko 2024-01-24T15:15:16.948 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ibmaem.ko 2024-01-24T15:15:16.948 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ibmpex.ko 2024-01-24T15:15:16.948 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ina209.ko 2024-01-24T15:15:16.948 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ina2xx.ko 2024-01-24T15:15:16.948 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/it87.ko 2024-01-24T15:15:16.948 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/k10temp.ko 2024-01-24T15:15:16.949 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/k8temp.ko 2024-01-24T15:15:16.949 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lineage-pem.ko 2024-01-24T15:15:16.949 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm63.ko 2024-01-24T15:15:16.949 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm73.ko 2024-01-24T15:15:16.949 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm75.ko 2024-01-24T15:15:16.949 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm77.ko 2024-01-24T15:15:16.949 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm78.ko 2024-01-24T15:15:16.949 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm80.ko 2024-01-24T15:15:16.949 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm83.ko 2024-01-24T15:15:16.949 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm85.ko 2024-01-24T15:15:16.949 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm87.ko 2024-01-24T15:15:16.949 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm90.ko 2024-01-24T15:15:16.949 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm92.ko 2024-01-24T15:15:16.949 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm93.ko 2024-01-24T15:15:16.949 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm95234.ko 2024-01-24T15:15:16.950 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm95241.ko 2024-01-24T15:15:16.950 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm95245.ko 2024-01-24T15:15:16.950 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc2945.ko 2024-01-24T15:15:16.950 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4151.ko 2024-01-24T15:15:16.950 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4215.ko 2024-01-24T15:15:16.950 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4222.ko 2024-01-24T15:15:16.950 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4245.ko 2024-01-24T15:15:16.950 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4260.ko 2024-01-24T15:15:16.950 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4261.ko 2024-01-24T15:15:16.950 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max16065.ko 2024-01-24T15:15:16.950 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max1619.ko 2024-01-24T15:15:16.950 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max1668.ko 2024-01-24T15:15:16.950 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max197.ko 2024-01-24T15:15:16.950 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max6639.ko 2024-01-24T15:15:16.950 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max6650.ko 2024-01-24T15:15:16.951 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max6697.ko 2024-01-24T15:15:16.951 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/mcp3021.ko 2024-01-24T15:15:16.951 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/nct6683.ko 2024-01-24T15:15:16.951 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/nct6775-core.ko 2024-01-24T15:15:16.951 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/nct6775.ko 2024-01-24T15:15:16.951 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/nct7802.ko 2024-01-24T15:15:16.951 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pc87360.ko 2024-01-24T15:15:16.951 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pc87427.ko 2024-01-24T15:15:16.951 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pcf8591.ko 2024-01-24T15:15:16.951 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus 2024-01-24T15:15:16.951 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-24T15:15:16.951 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-24T15:15:16.951 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-24T15:15:16.951 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-24T15:15:16.951 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-24T15:15:16.951 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-24T15:15:16.952 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-24T15:15:16.952 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-24T15:15:16.952 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-24T15:15:16.952 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-24T15:15:16.952 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-24T15:15:16.952 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-24T15:15:16.952 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/powr1220.ko 2024-01-24T15:15:16.952 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sch5627.ko 2024-01-24T15:15:16.952 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sch5636.ko 2024-01-24T15:15:16.952 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-24T15:15:16.952 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sht15.ko 2024-01-24T15:15:16.952 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sht21.ko 2024-01-24T15:15:16.952 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/shtc1.ko 2024-01-24T15:15:16.952 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sis5595.ko 2024-01-24T15:15:16.952 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/smsc47b397.ko 2024-01-24T15:15:16.953 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/smsc47m1.ko 2024-01-24T15:15:16.953 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/smsc47m192.ko 2024-01-24T15:15:16.953 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/thmc50.ko 2024-01-24T15:15:16.953 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/tmp102.ko 2024-01-24T15:15:16.953 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/tmp103.ko 2024-01-24T15:15:16.953 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/tmp401.ko 2024-01-24T15:15:16.953 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/tmp421.ko 2024-01-24T15:15:16.953 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/via-cputemp.ko 2024-01-24T15:15:16.953 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/via686a.ko 2024-01-24T15:15:16.953 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/vt1211.ko 2024-01-24T15:15:16.953 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/vt8231.ko 2024-01-24T15:15:16.953 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83627ehf.ko 2024-01-24T15:15:16.953 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83627hf.ko 2024-01-24T15:15:16.953 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83781d.ko 2024-01-24T15:15:16.953 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83791d.ko 2024-01-24T15:15:16.954 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83792d.ko 2024-01-24T15:15:16.954 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83793.ko 2024-01-24T15:15:16.954 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83795.ko 2024-01-24T15:15:16.954 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83l785ts.ko 2024-01-24T15:15:16.954 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83l786ng.ko 2024-01-24T15:15:16.954 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c 2024-01-24T15:15:16.954 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/algos 2024-01-24T15:15:16.954 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-24T15:15:16.954 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-24T15:15:16.954 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses 2024-01-24T15:15:16.954 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-24T15:15:16.954 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-24T15:15:16.954 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-24T15:15:16.954 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-24T15:15:16.954 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-24T15:15:16.954 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-24T15:15:16.954 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-24T15:15:16.955 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-24T15:15:16.955 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-24T15:15:16.955 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-24T15:15:16.955 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-24T15:15:16.955 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-24T15:15:16.955 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-24T15:15:16.955 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-24T15:15:16.955 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-24T15:15:16.955 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-24T15:15:16.955 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-24T15:15:16.955 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-24T15:15:16.955 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-24T15:15:16.955 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-24T15:15:16.955 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-24T15:15:16.955 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-24T15:15:16.955 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-24T15:15:16.955 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/i2c-dev.ko 2024-01-24T15:15:16.956 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/i2c-mux.ko 2024-01-24T15:15:16.956 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-01-24T15:15:16.956 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/i2c-smbus.ko 2024-01-24T15:15:16.956 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/i2c-stub.ko 2024-01-24T15:15:16.956 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband 2024-01-24T15:15:16.956 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core 2024-01-24T15:15:16.956 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-24T15:15:16.956 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ib_core.ko 2024-01-24T15:15:16.956 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-24T15:15:16.956 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-24T15:15:16.956 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-24T15:15:16.956 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-24T15:15:16.956 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-24T15:15:16.956 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw 2024-01-24T15:15:16.957 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/cxgb4 2024-01-24T15:15:16.957 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-24T15:15:16.957 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mlx4 2024-01-24T15:15:16.957 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-24T15:15:16.957 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mlx5 2024-01-24T15:15:16.957 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-24T15:15:16.957 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mthca 2024-01-24T15:15:16.957 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-24T15:15:16.957 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp 2024-01-24T15:15:16.957 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/ipoib 2024-01-24T15:15:16.957 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-24T15:15:16.957 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/iser 2024-01-24T15:15:16.957 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-24T15:15:16.958 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/isert 2024-01-24T15:15:16.958 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-24T15:15:16.958 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/srp 2024-01-24T15:15:16.958 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-24T15:15:16.958 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/srpt 2024-01-24T15:15:16.958 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-24T15:15:16.958 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input 2024-01-24T15:15:16.958 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/gameport 2024-01-24T15:15:16.958 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-24T15:15:16.958 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-24T15:15:16.958 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/gameport/gameport.ko 2024-01-24T15:15:16.958 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/joydev.ko 2024-01-24T15:15:16.958 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard 2024-01-24T15:15:16.958 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-24T15:15:16.958 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse 2024-01-24T15:15:16.958 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/appletouch.ko 2024-01-24T15:15:16.958 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/bcm5974.ko 2024-01-24T15:15:16.959 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/cyapatp.ko 2024-01-24T15:15:16.959 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-24T15:15:16.959 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/sermouse.ko 2024-01-24T15:15:16.959 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-24T15:15:16.959 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-24T15:15:16.959 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-24T15:15:16.959 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/rmi4 2024-01-24T15:15:16.959 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-24T15:15:16.959 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio 2024-01-24T15:15:16.959 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/altera_ps2.ko 2024-01-24T15:15:16.959 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/arc_ps2.ko 2024-01-24T15:15:16.959 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-24T15:15:16.959 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/serio_raw.ko 2024-01-24T15:15:16.959 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/sparse-keymap.ko 2024-01-24T15:15:16.959 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds 2024-01-24T15:15:16.959 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-blinkm.ko 2024-01-24T15:15:16.960 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-lm3530.ko 2024-01-24T15:15:16.960 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-lp3944.ko 2024-01-24T15:15:16.960 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-ss4200.ko 2024-01-24T15:15:16.960 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger 2024-01-24T15:15:16.960 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-24T15:15:16.960 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-24T15:15:16.960 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-24T15:15:16.960 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-24T15:15:16.960 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-01-24T15:15:16.960 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-24T15:15:16.960 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-24T15:15:16.960 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-24T15:15:16.960 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-24T15:15:16.960 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md 2024-01-24T15:15:16.960 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/bcache 2024-01-24T15:15:16.960 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/bcache/bcache.ko 2024-01-24T15:15:16.961 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-bio-prison.ko 2024-01-24T15:15:16.961 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-cache-smq.ko 2024-01-24T15:15:16.961 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-cache.ko 2024-01-24T15:15:16.961 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-crypt.ko 2024-01-24T15:15:16.961 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-delay.ko 2024-01-24T15:15:16.961 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-flakey.ko 2024-01-24T15:15:16.961 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-log-userspace.ko 2024-01-24T15:15:16.961 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-multipath.ko 2024-01-24T15:15:16.961 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-queue-length.ko 2024-01-24T15:15:16.961 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-raid.ko 2024-01-24T15:15:16.961 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-round-robin.ko 2024-01-24T15:15:16.961 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-service-time.ko 2024-01-24T15:15:16.961 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-switch.ko 2024-01-24T15:15:16.961 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-thin-pool.ko 2024-01-24T15:15:16.961 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-verity.ko 2024-01-24T15:15:16.962 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/faulty.ko 2024-01-24T15:15:16.962 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/linear.ko 2024-01-24T15:15:16.962 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/multipath.ko 2024-01-24T15:15:16.962 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/persistent-data 2024-01-24T15:15:16.962 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-24T15:15:16.962 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/raid0.ko 2024-01-24T15:15:16.962 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/raid1.ko 2024-01-24T15:15:16.962 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/raid10.ko 2024-01-24T15:15:16.962 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/raid456.ko 2024-01-24T15:15:16.962 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message 2024-01-24T15:15:16.962 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion 2024-01-24T15:15:16.962 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptbase.ko 2024-01-24T15:15:16.962 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptctl.ko 2024-01-24T15:15:16.962 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptfc.ko 2024-01-24T15:15:16.962 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptlan.ko 2024-01-24T15:15:16.963 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptsas.ko 2024-01-24T15:15:16.963 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptscsih.ko 2024-01-24T15:15:16.963 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptspi.ko 2024-01-24T15:15:16.963 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd 2024-01-24T15:15:16.963 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/lpc_ich.ko 2024-01-24T15:15:16.963 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/lpc_sch.ko 2024-01-24T15:15:16.963 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/mfd-core.ko 2024-01-24T15:15:16.963 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/sm501.ko 2024-01-24T15:15:16.963 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/viperboard.ko 2024-01-24T15:15:16.963 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/vx855.ko 2024-01-24T15:15:16.963 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/wl1273-core.ko 2024-01-24T15:15:16.963 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc 2024-01-24T15:15:16.963 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/altera-stapl 2024-01-24T15:15:16.964 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-24T15:15:16.964 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/apds9802als.ko 2024-01-24T15:15:16.964 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/apds990x.ko 2024-01-24T15:15:16.964 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/bh1770glc.ko 2024-01-24T15:15:16.964 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/cb710 2024-01-24T15:15:16.964 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/cb710/cb710.ko 2024-01-24T15:15:16.964 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/eeprom 2024-01-24T15:15:16.964 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/eeprom/at24.ko 2024-01-24T15:15:16.964 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-24T15:15:16.964 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/eeprom/max6875.ko 2024-01-24T15:15:16.964 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/enclosure.ko 2024-01-24T15:15:16.964 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/hpilo.ko 2024-01-24T15:15:16.965 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/isl29003.ko 2024-01-24T15:15:16.965 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/isl29020.ko 2024-01-24T15:15:16.965 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/lis3lv02d 2024-01-24T15:15:16.965 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-24T15:15:16.965 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-24T15:15:16.965 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/mei 2024-01-24T15:15:16.965 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/mei/mei-me.ko 2024-01-24T15:15:16.965 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/mei/mei-txe.ko 2024-01-24T15:15:16.965 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/mei/mei.ko 2024-01-24T15:15:16.965 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/sgi-gru 2024-01-24T15:15:16.965 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/sgi-gru/gru.ko 2024-01-24T15:15:16.965 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/sgi-xp 2024-01-24T15:15:16.965 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/sgi-xp/xp.ko 2024-01-24T15:15:16.965 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/sgi-xp/xpc.ko 2024-01-24T15:15:16.965 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-01-24T15:15:16.965 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/tifm_7xx1.ko 2024-01-24T15:15:16.966 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/tifm_core.ko 2024-01-24T15:15:16.966 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/tsl2550.ko 2024-01-24T15:15:16.966 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/vmw_balloon.ko 2024-01-24T15:15:16.966 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/vmw_vmci 2024-01-24T15:15:16.966 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-24T15:15:16.966 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net 2024-01-24T15:15:16.966 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/bonding 2024-01-24T15:15:16.966 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/bonding/bonding.ko 2024-01-24T15:15:16.966 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa 2024-01-24T15:15:16.966 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/b53 2024-01-24T15:15:16.966 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-24T15:15:16.966 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-24T15:15:16.966 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-24T15:15:16.966 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/mv88e6xxx 2024-01-24T15:15:16.967 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-24T15:15:16.967 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dummy.ko 2024-01-24T15:15:16.967 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/eql.ko 2024-01-24T15:15:16.967 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet 2024-01-24T15:15:16.967 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com 2024-01-24T15:15:16.967 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-24T15:15:16.967 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-24T15:15:16.967 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-24T15:15:16.967 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-24T15:15:16.967 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390 2024-01-24T15:15:16.967 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-24T15:15:16.967 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-24T15:15:16.967 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-24T15:15:16.967 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-24T15:15:16.967 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/adaptec 2024-01-24T15:15:16.968 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-24T15:15:16.968 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/agere 2024-01-24T15:15:16.968 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-24T15:15:16.968 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/alteon 2024-01-24T15:15:16.968 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-24T15:15:16.968 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/altera 2024-01-24T15:15:16.968 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-24T15:15:16.968 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/amd 2024-01-24T15:15:16.968 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-24T15:15:16.968 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-24T15:15:16.968 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-24T15:15:16.968 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros 2024-01-24T15:15:16.968 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/alx 2024-01-24T15:15:16.968 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-24T15:15:16.969 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atl1c 2024-01-24T15:15:16.969 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-24T15:15:16.969 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atl1e 2024-01-24T15:15:16.969 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-24T15:15:16.969 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atlx 2024-01-24T15:15:16.969 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-24T15:15:16.969 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-24T15:15:16.969 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom 2024-01-24T15:15:16.969 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-24T15:15:16.969 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-24T15:15:16.969 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-01-24T15:15:16.969 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-24T15:15:16.969 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-24T15:15:16.969 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/genet 2024-01-24T15:15:16.969 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-24T15:15:16.969 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-24T15:15:16.970 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/brocade 2024-01-24T15:15:16.970 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/brocade/bna 2024-01-24T15:15:16.970 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-24T15:15:16.970 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio 2024-01-24T15:15:16.970 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb 2024-01-24T15:15:16.970 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-24T15:15:16.970 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-01-24T15:15:16.970 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-24T15:15:16.970 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-01-24T15:15:16.970 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-24T15:15:16.970 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-01-24T15:15:16.970 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-24T15:15:16.970 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-01-24T15:15:16.970 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-24T15:15:16.970 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/cisco 2024-01-24T15:15:16.970 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/cisco/enic 2024-01-24T15:15:16.971 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-24T15:15:16.971 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec 2024-01-24T15:15:16.971 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip 2024-01-24T15:15:16.971 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-24T15:15:16.971 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-24T15:15:16.971 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-24T15:15:16.971 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-24T15:15:16.971 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-24T15:15:16.971 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-24T15:15:16.971 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dlink 2024-01-24T15:15:16.971 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-24T15:15:16.971 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-24T15:15:16.971 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dnet.ko 2024-01-24T15:15:16.971 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/emulex 2024-01-24T15:15:16.971 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/emulex/benet 2024-01-24T15:15:16.972 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-24T15:15:16.972 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/ethoc.ko 2024-01-24T15:15:16.972 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/fealnx.ko 2024-01-24T15:15:16.972 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel 2024-01-24T15:15:16.972 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-24T15:15:16.972 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e1000 2024-01-24T15:15:16.972 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-24T15:15:16.972 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e1000e 2024-01-24T15:15:16.972 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-24T15:15:16.972 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/fm10k 2024-01-24T15:15:16.972 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-24T15:15:16.972 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/i40e 2024-01-24T15:15:16.972 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-24T15:15:16.972 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/iavf 2024-01-24T15:15:16.973 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-24T15:15:16.973 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/igb 2024-01-24T15:15:16.973 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-24T15:15:16.973 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/igbvf 2024-01-24T15:15:16.973 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-24T15:15:16.973 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ixgbe 2024-01-24T15:15:16.973 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-24T15:15:16.973 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ixgbevf 2024-01-24T15:15:16.973 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-24T15:15:16.973 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/jme.ko 2024-01-24T15:15:16.973 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/marvell 2024-01-24T15:15:16.973 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-24T15:15:16.973 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-24T15:15:16.973 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-24T15:15:16.974 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox 2024-01-24T15:15:16.974 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx4 2024-01-24T15:15:16.974 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-24T15:15:16.974 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-24T15:15:16.974 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx5 2024-01-24T15:15:16.974 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-01-24T15:15:16.974 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-24T15:15:16.974 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/micrel 2024-01-24T15:15:16.974 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-24T15:15:16.974 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/myricom 2024-01-24T15:15:16.974 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/myricom/myri10ge 2024-01-24T15:15:16.974 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-24T15:15:16.975 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/natsemi 2024-01-24T15:15:16.975 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-24T15:15:16.975 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-24T15:15:16.975 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/neterion 2024-01-24T15:15:16.975 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-24T15:15:16.975 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/nvidia 2024-01-24T15:15:16.975 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-24T15:15:16.975 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/packetengines 2024-01-24T15:15:16.975 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-24T15:15:16.975 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-24T15:15:16.975 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic 2024-01-24T15:15:16.975 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/netxen 2024-01-24T15:15:16.975 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-24T15:15:16.975 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-24T15:15:16.975 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-01-24T15:15:16.975 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-24T15:15:16.975 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/rdc 2024-01-24T15:15:16.976 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-24T15:15:16.976 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek 2024-01-24T15:15:16.976 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-24T15:15:16.976 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-24T15:15:16.976 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-24T15:15:16.976 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-24T15:15:16.976 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/rocker 2024-01-24T15:15:16.976 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-01-24T15:15:16.976 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sfc 2024-01-24T15:15:16.976 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-24T15:15:16.976 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/silan 2024-01-24T15:15:16.976 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-24T15:15:16.976 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sis 2024-01-24T15:15:16.977 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-24T15:15:16.977 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-24T15:15:16.977 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc 2024-01-24T15:15:16.977 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-24T15:15:16.977 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-24T15:15:16.977 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-24T15:15:16.977 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-24T15:15:16.977 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro 2024-01-24T15:15:16.977 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/stmmac 2024-01-24T15:15:16.977 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-24T15:15:16.977 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-24T15:15:16.977 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun 2024-01-24T15:15:16.977 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-24T15:15:16.977 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-24T15:15:16.977 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-24T15:15:16.977 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-24T15:15:16.978 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/tehuti 2024-01-24T15:15:16.978 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-24T15:15:16.978 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/ti 2024-01-24T15:15:16.978 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-24T15:15:16.978 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/via 2024-01-24T15:15:16.978 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-24T15:15:16.978 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-24T15:15:16.978 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/wiznet 2024-01-24T15:15:16.978 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-24T15:15:16.978 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-24T15:15:16.978 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/xircom 2024-01-24T15:15:16.978 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-24T15:15:16.978 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/geneve.ko 2024-01-24T15:15:16.978 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/hyperv 2024-01-24T15:15:16.979 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-24T15:15:16.979 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ieee802154 2024-01-24T15:15:16.979 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-24T15:15:16.979 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ifb.ko 2024-01-24T15:15:16.979 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ipvlan 2024-01-24T15:15:16.979 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-24T15:15:16.979 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/macvlan.ko 2024-01-24T15:15:16.979 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/macvtap.ko 2024-01-24T15:15:16.979 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio 2024-01-24T15:15:16.979 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio.ko 2024-01-24T15:15:16.979 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-24T15:15:16.979 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-24T15:15:16.979 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-24T15:15:16.979 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mii.ko 2024-01-24T15:15:16.979 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/net_failover.ko 2024-01-24T15:15:16.980 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/netconsole.ko 2024-01-24T15:15:16.980 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/nlmon.ko 2024-01-24T15:15:16.980 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/pcs 2024-01-24T15:15:16.980 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-24T15:15:16.980 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-24T15:15:16.980 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy 2024-01-24T15:15:16.980 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/amd.ko 2024-01-24T15:15:16.980 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-24T15:15:16.980 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-01-24T15:15:16.980 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-24T15:15:16.980 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/bcm87xx.ko 2024-01-24T15:15:16.980 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/broadcom.ko 2024-01-24T15:15:16.980 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/cicada.ko 2024-01-24T15:15:16.980 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/davicom.ko 2024-01-24T15:15:16.981 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/dp83640.ko 2024-01-24T15:15:16.981 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/et1011c.ko 2024-01-24T15:15:16.981 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/icplus.ko 2024-01-24T15:15:16.981 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/lxt.ko 2024-01-24T15:15:16.981 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/marvell.ko 2024-01-24T15:15:16.981 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/micrel.ko 2024-01-24T15:15:16.981 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/national.ko 2024-01-24T15:15:16.981 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/phylink.ko 2024-01-24T15:15:16.981 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/qsemi.ko 2024-01-24T15:15:16.981 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/realtek.ko 2024-01-24T15:15:16.981 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/smsc.ko 2024-01-24T15:15:16.981 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/ste10Xp.ko 2024-01-24T15:15:16.981 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/vitesse.ko 2024-01-24T15:15:16.982 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp 2024-01-24T15:15:16.982 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-24T15:15:16.982 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_async.ko 2024-01-24T15:15:16.982 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-24T15:15:16.982 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_generic.ko 2024-01-24T15:15:16.982 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-24T15:15:16.982 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-24T15:15:16.982 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/pppoe.ko 2024-01-24T15:15:16.982 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/pppox.ko 2024-01-24T15:15:16.982 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/pptp.ko 2024-01-24T15:15:16.982 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/slip 2024-01-24T15:15:16.982 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/slip/slhc.ko 2024-01-24T15:15:16.982 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/slip/slip.ko 2024-01-24T15:15:16.983 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/sungem_phy.ko 2024-01-24T15:15:16.983 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/tap.ko 2024-01-24T15:15:16.983 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team 2024-01-24T15:15:16.983 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team.ko 2024-01-24T15:15:16.983 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-24T15:15:16.983 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-24T15:15:16.983 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-24T15:15:16.983 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_random.ko 2024-01-24T15:15:16.983 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-24T15:15:16.983 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/tun.ko 2024-01-24T15:15:16.983 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/veth.ko 2024-01-24T15:15:16.983 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/virtio_net.ko 2024-01-24T15:15:16.983 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/vmxnet3 2024-01-24T15:15:16.983 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-24T15:15:16.983 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/vxlan 2024-01-24T15:15:16.984 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/vxlan/vxlan.ko 2024-01-24T15:15:16.984 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/xen-netback 2024-01-24T15:15:16.984 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-24T15:15:16.984 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/xen-netfront.ko 2024-01-24T15:15:16.984 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ntb 2024-01-24T15:15:16.984 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ntb/ntb.ko 2024-01-24T15:15:16.984 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/nvme 2024-01-24T15:15:16.984 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/nvme/host 2024-01-24T15:15:16.984 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/nvme/host/nvme-core.ko 2024-01-24T15:15:16.984 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/nvme/host/nvme.ko 2024-01-24T15:15:16.984 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport 2024-01-24T15:15:16.984 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/parport.ko 2024-01-24T15:15:16.984 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/parport_cs.ko 2024-01-24T15:15:16.984 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/parport_pc.ko 2024-01-24T15:15:16.984 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/parport_serial.ko 2024-01-24T15:15:16.985 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci 2024-01-24T15:15:16.985 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/hotplug 2024-01-24T15:15:16.985 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-24T15:15:16.985 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/pcie 2024-01-24T15:15:16.985 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/pcie/aer_inject.ko 2024-01-24T15:15:16.985 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/xen-pcifront.ko 2024-01-24T15:15:16.985 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia 2024-01-24T15:15:16.985 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/i82092.ko 2024-01-24T15:15:16.985 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/pd6729.ko 2024-01-24T15:15:16.985 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-24T15:15:16.985 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pinctrl 2024-01-24T15:15:16.985 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pinctrl/intel 2024-01-24T15:15:16.985 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-24T15:15:16.985 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform 2024-01-24T15:15:16.985 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86 2024-01-24T15:15:16.986 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-24T15:15:16.986 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/acerhdf.ko 2024-01-24T15:15:16.986 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-24T15:15:16.986 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-24T15:15:16.986 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-24T15:15:16.986 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-24T15:15:16.986 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-24T15:15:16.986 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-24T15:15:16.986 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-24T15:15:16.986 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-24T15:15:16.986 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-24T15:15:16.986 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/hdaps.ko 2024-01-24T15:15:16.986 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/intel 2024-01-24T15:15:16.986 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-24T15:15:16.986 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/intel_ips.ko 2024-01-24T15:15:16.987 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-24T15:15:16.987 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-24T15:15:16.987 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-24T15:15:16.987 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-24T15:15:16.987 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-24T15:15:16.987 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-24T15:15:16.987 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-24T15:15:16.987 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-24T15:15:16.987 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-24T15:15:16.987 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/wmi.ko 2024-01-24T15:15:16.987 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/powercap 2024-01-24T15:15:16.987 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-24T15:15:16.987 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-24T15:15:16.987 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps 2024-01-24T15:15:16.987 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/clients 2024-01-24T15:15:16.988 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-24T15:15:16.988 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-24T15:15:16.988 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/clients/pps_parport.ko 2024-01-24T15:15:16.988 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/pps_core.ko 2024-01-24T15:15:16.988 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ptp 2024-01-24T15:15:16.988 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ptp/ptp.ko 2024-01-24T15:15:16.988 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ptp/ptp_kvm.ko 2024-01-24T15:15:16.988 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc 2024-01-24T15:15:16.988 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-24T15:15:16.988 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-24T15:15:16.988 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-24T15:15:16.988 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-24T15:15:16.988 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-24T15:15:16.989 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-24T15:15:16.989 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-24T15:15:16.989 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-24T15:15:16.989 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-24T15:15:16.989 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-24T15:15:16.989 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-em3027.ko 2024-01-24T15:15:16.989 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-24T15:15:16.989 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-24T15:15:16.989 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-24T15:15:16.989 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-24T15:15:16.989 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-24T15:15:16.989 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-24T15:15:16.989 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-max6900.ko 2024-01-24T15:15:16.989 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-24T15:15:16.990 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-24T15:15:16.990 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-24T15:15:16.990 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-24T15:15:16.990 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-24T15:15:16.990 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-24T15:15:16.990 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-24T15:15:16.990 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-24T15:15:16.990 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-24T15:15:16.990 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-24T15:15:16.990 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-24T15:15:16.990 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-24T15:15:16.990 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-x1205.ko 2024-01-24T15:15:16.990 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi 2024-01-24T15:15:16.990 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/3w-9xxx.ko 2024-01-24T15:15:16.991 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/3w-sas.ko 2024-01-24T15:15:16.991 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/3w-xxxx.ko 2024-01-24T15:15:16.991 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/BusLogic.ko 2024-01-24T15:15:16.991 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/a100u2w.ko 2024-01-24T15:15:16.991 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aacraid 2024-01-24T15:15:16.991 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-24T15:15:16.991 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/advansys.ko 2024-01-24T15:15:16.991 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aic7xxx 2024-01-24T15:15:16.991 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-24T15:15:16.991 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-24T15:15:16.991 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/am53c974.ko 2024-01-24T15:15:16.991 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/arcmsr 2024-01-24T15:15:16.991 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-24T15:15:16.991 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/atp870u.ko 2024-01-24T15:15:16.991 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/be2iscsi 2024-01-24T15:15:16.992 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-24T15:15:16.992 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bfa 2024-01-24T15:15:16.992 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bfa/bfa.ko 2024-01-24T15:15:16.992 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bnx2fc 2024-01-24T15:15:16.992 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-24T15:15:16.992 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bnx2i 2024-01-24T15:15:16.992 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-24T15:15:16.992 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ch.ko 2024-01-24T15:15:16.992 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/csiostor 2024-01-24T15:15:16.992 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-24T15:15:16.992 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi 2024-01-24T15:15:16.992 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/cxgb3i 2024-01-24T15:15:16.992 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-24T15:15:16.992 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/cxgb4i 2024-01-24T15:15:16.993 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-24T15:15:16.993 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-24T15:15:16.993 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/dc395x.ko 2024-01-24T15:15:16.993 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/device_handler 2024-01-24T15:15:16.993 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-01-24T15:15:16.993 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-01-24T15:15:16.993 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-01-24T15:15:16.993 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-01-24T15:15:16.993 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/dmx3191d.ko 2024-01-24T15:15:16.993 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/esas2r 2024-01-24T15:15:16.993 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-24T15:15:16.993 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/esp_scsi.ko 2024-01-24T15:15:16.993 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fcoe 2024-01-24T15:15:16.993 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-24T15:15:16.993 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-24T15:15:16.994 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fnic 2024-01-24T15:15:16.994 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fnic/fnic.ko 2024-01-24T15:15:16.994 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/hpsa.ko 2024-01-24T15:15:16.994 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/hptiop.ko 2024-01-24T15:15:16.994 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/hv_storvsc.ko 2024-01-24T15:15:16.994 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/initio.ko 2024-01-24T15:15:16.994 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ipr.ko 2024-01-24T15:15:16.994 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ips.ko 2024-01-24T15:15:16.994 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/isci 2024-01-24T15:15:16.994 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/isci/isci.ko 2024-01-24T15:15:16.994 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-24T15:15:16.994 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-24T15:15:16.994 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libfc 2024-01-24T15:15:16.995 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libfc/libfc.ko 2024-01-24T15:15:16.995 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libiscsi.ko 2024-01-24T15:15:16.995 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-24T15:15:16.995 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libsas 2024-01-24T15:15:16.995 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libsas/libsas.ko 2024-01-24T15:15:16.995 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/lpfc 2024-01-24T15:15:16.995 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-24T15:15:16.995 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid 2024-01-24T15:15:16.995 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid.ko 2024-01-24T15:15:16.995 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-24T15:15:16.995 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-24T15:15:16.995 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-24T15:15:16.995 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mpt3sas 2024-01-24T15:15:16.995 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-24T15:15:16.995 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mvsas 2024-01-24T15:15:16.996 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-24T15:15:16.996 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mvumi.ko 2024-01-24T15:15:16.996 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pm8001 2024-01-24T15:15:16.996 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-24T15:15:16.996 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pmcraid.ko 2024-01-24T15:15:16.996 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla1280.ko 2024-01-24T15:15:16.996 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla2xxx 2024-01-24T15:15:16.996 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-24T15:15:16.996 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-24T15:15:16.996 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla4xxx 2024-01-24T15:15:16.996 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-24T15:15:16.996 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/raid_class.ko 2024-01-24T15:15:16.996 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_debug.ko 2024-01-24T15:15:16.996 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-24T15:15:16.997 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-24T15:15:16.997 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-24T15:15:16.997 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-24T15:15:16.997 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-24T15:15:16.997 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ses.ko 2024-01-24T15:15:16.997 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/st.ko 2024-01-24T15:15:16.997 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/stex.ko 2024-01-24T15:15:16.997 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/sym53c8xx_2 2024-01-24T15:15:16.997 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-24T15:15:16.997 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/virtio_scsi.ko 2024-01-24T15:15:16.997 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-24T15:15:16.997 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/wd719x.ko 2024-01-24T15:15:16.997 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ssb 2024-01-24T15:15:16.997 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ssb/ssb.ko 2024-01-24T15:15:16.998 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target 2024-01-24T15:15:16.998 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/iscsi 2024-01-24T15:15:16.998 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-24T15:15:16.998 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/loopback 2024-01-24T15:15:16.998 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-24T15:15:16.998 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_file.ko 2024-01-24T15:15:16.998 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_iblock.ko 2024-01-24T15:15:16.998 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_mod.ko 2024-01-24T15:15:16.998 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_pscsi.ko 2024-01-24T15:15:16.998 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_user.ko 2024-01-24T15:15:16.998 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/tcm_fc 2024-01-24T15:15:16.998 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-24T15:15:16.998 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal 2024-01-24T15:15:16.998 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel 2024-01-24T15:15:16.998 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal 2024-01-24T15:15:16.999 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-24T15:15:16.999 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-24T15:15:16.999 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-24T15:15:16.999 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-24T15:15:16.999 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-24T15:15:16.999 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-24T15:15:16.999 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-24T15:15:16.999 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-24T15:15:16.999 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-24T15:15:16.999 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-24T15:15:16.999 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-01-24T15:15:16.999 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-24T15:15:16.999 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-24T15:15:16.999 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-01-24T15:15:16.999 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-01-24T15:15:17.000 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-24T15:15:17.000 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-24T15:15:17.000 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-24T15:15:17.000 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty 2024-01-24T15:15:17.000 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/ipwireless 2024-01-24T15:15:17.000 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-24T15:15:17.000 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/n_gsm.ko 2024-01-24T15:15:17.000 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/n_hdlc.ko 2024-01-24T15:15:17.000 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/nozomi.ko 2024-01-24T15:15:17.000 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial 2024-01-24T15:15:17.000 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/8250 2024-01-24T15:15:17.000 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-24T15:15:17.000 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/arc_uart.ko 2024-01-24T15:15:17.001 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/jsm 2024-01-24T15:15:17.001 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-24T15:15:17.001 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs 2024-01-24T15:15:17.001 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/core 2024-01-24T15:15:17.001 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-24T15:15:17.001 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/host 2024-01-24T15:15:17.001 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-24T15:15:17.001 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio 2024-01-24T15:15:17.001 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio.ko 2024-01-24T15:15:17.001 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_aec.ko 2024-01-24T15:15:17.001 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_cif.ko 2024-01-24T15:15:17.001 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_pci_generic.ko 2024-01-24T15:15:17.001 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_sercos3.ko 2024-01-24T15:15:17.001 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb 2024-01-24T15:15:17.001 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class 2024-01-24T15:15:17.002 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/cdc-acm.ko 2024-01-24T15:15:17.002 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-24T15:15:17.002 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/usblp.ko 2024-01-24T15:15:17.002 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/usbtmc.ko 2024-01-24T15:15:17.002 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host 2024-01-24T15:15:17.002 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-24T15:15:17.002 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/image 2024-01-24T15:15:17.002 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/image/mdc800.ko 2024-01-24T15:15:17.002 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/image/microtek.ko 2024-01-24T15:15:17.002 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc 2024-01-24T15:15:17.002 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/adutux.ko 2024-01-24T15:15:17.002 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/appledisplay.ko 2024-01-24T15:15:17.002 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/emi26.ko 2024-01-24T15:15:17.002 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/emi62.ko 2024-01-24T15:15:17.002 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/ezusb.ko 2024-01-24T15:15:17.003 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/idmouse.ko 2024-01-24T15:15:17.003 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/iowarrior.ko 2024-01-24T15:15:17.003 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-24T15:15:17.003 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/ldusb.ko 2024-01-24T15:15:17.003 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/legousbtower.ko 2024-01-24T15:15:17.003 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/sisusbvga 2024-01-24T15:15:17.003 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-24T15:15:17.003 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-24T15:15:17.003 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/usb3503.ko 2024-01-24T15:15:17.003 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/usblcd.ko 2024-01-24T15:15:17.003 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-24T15:15:17.003 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/uss720.ko 2024-01-24T15:15:17.003 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/yurex.ko 2024-01-24T15:15:17.003 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/phy 2024-01-24T15:15:17.004 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/phy/phy-generic.ko 2024-01-24T15:15:17.004 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial 2024-01-24T15:15:17.004 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/aircable.ko 2024-01-24T15:15:17.004 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ark3116.ko 2024-01-24T15:15:17.004 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-24T15:15:17.004 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ch341.ko 2024-01-24T15:15:17.004 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/cp210x.ko 2024-01-24T15:15:17.004 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/cyberjack.ko 2024-01-24T15:15:17.004 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-24T15:15:17.004 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-24T15:15:17.004 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/empeg.ko 2024-01-24T15:15:17.004 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-24T15:15:17.004 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-24T15:15:17.005 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-24T15:15:17.005 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/io_ti.ko 2024-01-24T15:15:17.005 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ipaq.ko 2024-01-24T15:15:17.005 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ipw.ko 2024-01-24T15:15:17.005 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ir-usb.ko 2024-01-24T15:15:17.005 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-24T15:15:17.005 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/keyspan.ko 2024-01-24T15:15:17.005 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-24T15:15:17.005 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-24T15:15:17.005 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-24T15:15:17.005 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/mct_u232.ko 2024-01-24T15:15:17.005 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/mos7720.ko 2024-01-24T15:15:17.005 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/mos7840.ko 2024-01-24T15:15:17.005 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/navman.ko 2024-01-24T15:15:17.006 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/omninet.ko 2024-01-24T15:15:17.006 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/opticon.ko 2024-01-24T15:15:17.006 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/option.ko 2024-01-24T15:15:17.006 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/oti6858.ko 2024-01-24T15:15:17.006 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/pl2303.ko 2024-01-24T15:15:17.006 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/qcaux.ko 2024-01-24T15:15:17.006 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/qcserial.ko 2024-01-24T15:15:17.006 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/quatech2.ko 2024-01-24T15:15:17.006 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/safe_serial.ko 2024-01-24T15:15:17.006 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/sierra.ko 2024-01-24T15:15:17.006 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-24T15:15:17.006 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ssu100.ko 2024-01-24T15:15:17.006 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/symbolserial.ko 2024-01-24T15:15:17.006 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-24T15:15:17.007 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-24T15:15:17.007 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/usb_debug.ko 2024-01-24T15:15:17.007 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-24T15:15:17.007 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/visor.ko 2024-01-24T15:15:17.007 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/whiteheat.ko 2024-01-24T15:15:17.007 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-24T15:15:17.007 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage 2024-01-24T15:15:17.007 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/uas.ko 2024-01-24T15:15:17.007 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-24T15:15:17.007 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-24T15:15:17.007 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-24T15:15:17.007 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-24T15:15:17.007 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-24T15:15:17.007 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-24T15:15:17.007 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-24T15:15:17.008 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-karma.ko 2024-01-24T15:15:17.008 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-24T15:15:17.008 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-24T15:15:17.008 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-24T15:15:17.008 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-24T15:15:17.008 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-24T15:15:17.008 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/usb-storage.ko 2024-01-24T15:15:17.008 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/usbip 2024-01-24T15:15:17.008 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-24T15:15:17.008 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-24T15:15:17.008 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-24T15:15:17.008 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio 2024-01-24T15:15:17.008 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/pci 2024-01-24T15:15:17.009 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-24T15:15:17.009 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-24T15:15:17.009 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/vfio.ko 2024-01-24T15:15:17.009 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-24T15:15:17.009 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost 2024-01-24T15:15:17.009 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/vhost.ko 2024-01-24T15:15:17.009 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-24T15:15:17.009 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/vhost_net.ko 2024-01-24T15:15:17.009 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/vhost_scsi.ko 2024-01-24T15:15:17.009 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/video 2024-01-24T15:15:17.009 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight 2024-01-24T15:15:17.009 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/apple_bl.ko 2024-01-24T15:15:17.009 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/lcd.ko 2024-01-24T15:15:17.009 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-24T15:15:17.010 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/virtio 2024-01-24T15:15:17.010 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/virtio/virtio.ko 2024-01-24T15:15:17.010 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/virtio/virtio_balloon.ko 2024-01-24T15:15:17.010 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/virtio/virtio_mmio.ko 2024-01-24T15:15:17.010 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/virtio/virtio_pci.ko 2024-01-24T15:15:17.010 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-01-24T15:15:17.010 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-01-24T15:15:17.010 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/virtio/virtio_ring.ko 2024-01-24T15:15:17.010 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1 2024-01-24T15:15:17.010 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/masters 2024-01-24T15:15:17.010 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/masters/ds2482.ko 2024-01-24T15:15:17.010 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/masters/ds2490.ko 2024-01-24T15:15:17.010 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves 2024-01-24T15:15:17.010 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-24T15:15:17.011 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-24T15:15:17.011 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-24T15:15:17.011 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-24T15:15:17.011 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-24T15:15:17.011 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-24T15:15:17.011 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-24T15:15:17.011 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-24T15:15:17.011 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-24T15:15:17.011 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-24T15:15:17.011 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-24T15:15:17.011 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/wire.ko 2024-01-24T15:15:17.011 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog 2024-01-24T15:15:17.011 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-24T15:15:17.011 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-24T15:15:17.012 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-24T15:15:17.012 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/hpwdt.ko 2024-01-24T15:15:17.012 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/i6300esb.ko 2024-01-24T15:15:17.012 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-24T15:15:17.012 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-24T15:15:17.012 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/ib700wdt.ko 2024-01-24T15:15:17.012 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/ibmasr.ko 2024-01-24T15:15:17.012 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-24T15:15:17.012 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-24T15:15:17.012 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/it87_wdt.ko 2024-01-24T15:15:17.012 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/machzwd.ko 2024-01-24T15:15:17.012 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/nv_tco.ko 2024-01-24T15:15:17.012 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-24T15:15:17.012 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-24T15:15:17.012 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-24T15:15:17.013 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-24T15:15:17.013 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/softdog.ko 2024-01-24T15:15:17.013 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-24T15:15:17.013 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/via_wdt.ko 2024-01-24T15:15:17.013 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-24T15:15:17.013 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-24T15:15:17.013 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-24T15:15:17.013 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/wdt_pci.ko 2024-01-24T15:15:17.013 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/xen_wdt.ko 2024-01-24T15:15:17.013 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen 2024-01-24T15:15:17.013 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-acpi-processor.ko 2024-01-24T15:15:17.013 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-evtchn.ko 2024-01-24T15:15:17.013 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-gntalloc.ko 2024-01-24T15:15:17.013 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-gntdev.ko 2024-01-24T15:15:17.014 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-pciback 2024-01-24T15:15:17.014 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-24T15:15:17.014 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-privcmd.ko 2024-01-24T15:15:17.014 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xenfs 2024-01-24T15:15:17.014 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-24T15:15:17.014 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs 2024-01-24T15:15:17.014 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/9p 2024-01-24T15:15:17.014 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/9p/9p.ko 2024-01-24T15:15:17.014 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/affs 2024-01-24T15:15:17.014 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/affs/affs.ko 2024-01-24T15:15:17.014 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/befs 2024-01-24T15:15:17.014 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/befs/befs.ko 2024-01-24T15:15:17.014 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/binfmt_misc.ko 2024-01-24T15:15:17.015 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/btrfs 2024-01-24T15:15:17.015 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/btrfs/btrfs.ko 2024-01-24T15:15:17.015 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/cachefiles 2024-01-24T15:15:17.015 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/cachefiles/cachefiles.ko 2024-01-24T15:15:17.015 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ceph 2024-01-24T15:15:17.015 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ceph/ceph.ko 2024-01-24T15:15:17.015 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/coda 2024-01-24T15:15:17.015 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/coda/coda.ko 2024-01-24T15:15:17.015 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/cramfs 2024-01-24T15:15:17.015 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/cramfs/cramfs.ko 2024-01-24T15:15:17.015 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/dlm 2024-01-24T15:15:17.015 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/dlm/dlm.ko 2024-01-24T15:15:17.015 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ecryptfs 2024-01-24T15:15:17.015 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ecryptfs/ecryptfs.ko 2024-01-24T15:15:17.015 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/f2fs 2024-01-24T15:15:17.016 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/f2fs/f2fs.ko 2024-01-24T15:15:17.016 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fat 2024-01-24T15:15:17.016 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fat/fat.ko 2024-01-24T15:15:17.016 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fat/msdos.ko 2024-01-24T15:15:17.016 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fat/vfat.ko 2024-01-24T15:15:17.016 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fscache 2024-01-24T15:15:17.016 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fscache/fscache.ko 2024-01-24T15:15:17.016 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fuse 2024-01-24T15:15:17.016 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fuse/cuse.ko 2024-01-24T15:15:17.016 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fuse/fuse.ko 2024-01-24T15:15:17.016 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/gfs2 2024-01-24T15:15:17.016 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/gfs2/gfs2.ko 2024-01-24T15:15:17.016 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/hfs 2024-01-24T15:15:17.016 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/hfs/hfs.ko 2024-01-24T15:15:17.016 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/hfsplus 2024-01-24T15:15:17.017 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/hfsplus/hfsplus.ko 2024-01-24T15:15:17.017 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/isofs 2024-01-24T15:15:17.017 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/isofs/isofs.ko 2024-01-24T15:15:17.017 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/jfs 2024-01-24T15:15:17.017 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/jfs/jfs.ko 2024-01-24T15:15:17.017 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/lockd 2024-01-24T15:15:17.017 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/lockd/lockd.ko 2024-01-24T15:15:17.017 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/minix 2024-01-24T15:15:17.017 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/minix/minix.ko 2024-01-24T15:15:17.017 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/netfs 2024-01-24T15:15:17.017 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/netfs/netfs.ko 2024-01-24T15:15:17.017 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs 2024-01-24T15:15:17.017 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/blocklayout 2024-01-24T15:15:17.017 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-24T15:15:17.018 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/filelayout 2024-01-24T15:15:17.018 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-24T15:15:17.018 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/flexfilelayout 2024-01-24T15:15:17.018 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-24T15:15:17.018 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/nfs.ko 2024-01-24T15:15:17.018 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/nfsv3.ko 2024-01-24T15:15:17.018 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/nfsv4.ko 2024-01-24T15:15:17.018 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs_common 2024-01-24T15:15:17.018 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs_common/grace.ko 2024-01-24T15:15:17.018 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs_common/nfs_acl.ko 2024-01-24T15:15:17.018 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfsd 2024-01-24T15:15:17.018 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfsd/nfsd.ko 2024-01-24T15:15:17.018 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nilfs2 2024-01-24T15:15:17.018 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nilfs2/nilfs2.ko 2024-01-24T15:15:17.019 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls 2024-01-24T15:15:17.019 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-celtic.ko 2024-01-24T15:15:17.019 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-centeuro.ko 2024-01-24T15:15:17.019 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-croatian.ko 2024-01-24T15:15:17.019 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-cyrillic.ko 2024-01-24T15:15:17.019 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-gaelic.ko 2024-01-24T15:15:17.019 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-greek.ko 2024-01-24T15:15:17.019 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-iceland.ko 2024-01-24T15:15:17.019 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-inuit.ko 2024-01-24T15:15:17.019 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-roman.ko 2024-01-24T15:15:17.019 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-romanian.ko 2024-01-24T15:15:17.019 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-turkish.ko 2024-01-24T15:15:17.019 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp1250.ko 2024-01-24T15:15:17.020 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp1251.ko 2024-01-24T15:15:17.020 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp1255.ko 2024-01-24T15:15:17.020 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp737.ko 2024-01-24T15:15:17.020 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp775.ko 2024-01-24T15:15:17.020 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp850.ko 2024-01-24T15:15:17.020 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp852.ko 2024-01-24T15:15:17.020 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp855.ko 2024-01-24T15:15:17.020 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp857.ko 2024-01-24T15:15:17.020 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp860.ko 2024-01-24T15:15:17.020 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp861.ko 2024-01-24T15:15:17.020 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp862.ko 2024-01-24T15:15:17.020 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp863.ko 2024-01-24T15:15:17.020 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp864.ko 2024-01-24T15:15:17.020 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp865.ko 2024-01-24T15:15:17.021 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp866.ko 2024-01-24T15:15:17.021 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp869.ko 2024-01-24T15:15:17.021 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp874.ko 2024-01-24T15:15:17.021 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp932.ko 2024-01-24T15:15:17.021 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp936.ko 2024-01-24T15:15:17.021 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp949.ko 2024-01-24T15:15:17.021 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp950.ko 2024-01-24T15:15:17.021 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_euc-jp.ko 2024-01-24T15:15:17.021 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-1.ko 2024-01-24T15:15:17.021 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-13.ko 2024-01-24T15:15:17.021 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-14.ko 2024-01-24T15:15:17.021 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-15.ko 2024-01-24T15:15:17.021 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-2.ko 2024-01-24T15:15:17.021 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-3.ko 2024-01-24T15:15:17.021 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-4.ko 2024-01-24T15:15:17.022 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-5.ko 2024-01-24T15:15:17.022 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-6.ko 2024-01-24T15:15:17.022 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-7.ko 2024-01-24T15:15:17.022 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-9.ko 2024-01-24T15:15:17.022 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_koi8-r.ko 2024-01-24T15:15:17.022 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_koi8-ru.ko 2024-01-24T15:15:17.022 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_koi8-u.ko 2024-01-24T15:15:17.022 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-24T15:15:17.022 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_utf8.ko 2024-01-24T15:15:17.022 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2 2024-01-24T15:15:17.022 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/cluster 2024-01-24T15:15:17.022 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-24T15:15:17.022 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/dlm 2024-01-24T15:15:17.022 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-24T15:15:17.023 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/dlmfs 2024-01-24T15:15:17.023 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-24T15:15:17.023 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ocfs2.ko 2024-01-24T15:15:17.023 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-24T15:15:17.023 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-24T15:15:17.023 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-24T15:15:17.023 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/overlayfs 2024-01-24T15:15:17.023 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/overlayfs/overlay.ko 2024-01-24T15:15:17.023 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/pstore 2024-01-24T15:15:17.023 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/pstore/ramoops.ko 2024-01-24T15:15:17.023 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/reiserfs 2024-01-24T15:15:17.023 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/reiserfs/reiserfs.ko 2024-01-24T15:15:17.023 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/romfs 2024-01-24T15:15:17.023 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/romfs/romfs.ko 2024-01-24T15:15:17.024 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/smb 2024-01-24T15:15:17.024 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/client 2024-01-24T15:15:17.024 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/client/cifs.ko 2024-01-24T15:15:17.024 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/common 2024-01-24T15:15:17.024 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/common/cifs_arc4.ko 2024-01-24T15:15:17.024 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/common/cifs_md4.ko 2024-01-24T15:15:17.024 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/squashfs 2024-01-24T15:15:17.024 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/squashfs/squashfs.ko 2024-01-24T15:15:17.024 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/sysv 2024-01-24T15:15:17.024 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/sysv/sysv.ko 2024-01-24T15:15:17.024 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/udf 2024-01-24T15:15:17.024 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/udf/udf.ko 2024-01-24T15:15:17.024 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ufs 2024-01-24T15:15:17.024 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ufs/ufs.ko 2024-01-24T15:15:17.025 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/xfs 2024-01-24T15:15:17.025 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/xfs/xfs.ko 2024-01-24T15:15:17.025 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/kernel 2024-01-24T15:15:17.025 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/kernel/rcu 2024-01-24T15:15:17.025 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/kernel/rcu/rcutorture.ko 2024-01-24T15:15:17.025 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/kernel/torture.ko 2024-01-24T15:15:17.025 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/kernel/trace 2024-01-24T15:15:17.025 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-01-24T15:15:17.025 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib 2024-01-24T15:15:17.025 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/asn1_encoder.ko 2024-01-24T15:15:17.025 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/crc-itu-t.ko 2024-01-24T15:15:17.025 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/crc8.ko 2024-01-24T15:15:17.025 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/crypto 2024-01-24T15:15:17.025 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/crypto/libarc4.ko 2024-01-24T15:15:17.025 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/crypto/libdes.ko 2024-01-24T15:15:17.026 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/libcrc32c.ko 2024-01-24T15:15:17.026 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/lru_cache.ko 2024-01-24T15:15:17.026 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/lz4 2024-01-24T15:15:17.026 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/lz4/lz4_compress.ko 2024-01-24T15:15:17.026 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/lz4/lz4hc_compress.ko 2024-01-24T15:15:17.026 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/math 2024-01-24T15:15:17.026 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/math/cordic.ko 2024-01-24T15:15:17.026 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/raid6 2024-01-24T15:15:17.026 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/raid6/raid6_pq.ko 2024-01-24T15:15:17.026 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/reed_solomon 2024-01-24T15:15:17.026 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-24T15:15:17.026 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/ts_bm.ko 2024-01-24T15:15:17.026 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/ts_fsm.ko 2024-01-24T15:15:17.026 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/ts_kmp.ko 2024-01-24T15:15:17.026 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/zstd 2024-01-24T15:15:17.027 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/zstd/zstd_compress.ko 2024-01-24T15:15:17.027 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/mm 2024-01-24T15:15:17.027 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/mm/hwpoison-inject.ko 2024-01-24T15:15:17.027 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net 2024-01-24T15:15:17.027 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan 2024-01-24T15:15:17.027 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/6lowpan.ko 2024-01-24T15:15:17.027 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_dest.ko 2024-01-24T15:15:17.027 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_fragment.ko 2024-01-24T15:15:17.027 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_hop.ko 2024-01-24T15:15:17.027 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-24T15:15:17.027 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_mobility.ko 2024-01-24T15:15:17.027 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_routing.ko 2024-01-24T15:15:17.027 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_udp.ko 2024-01-24T15:15:17.027 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/802 2024-01-24T15:15:17.027 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/802/garp.ko 2024-01-24T15:15:17.028 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/802/mrp.ko 2024-01-24T15:15:17.028 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/802/p8022.ko 2024-01-24T15:15:17.028 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/802/psnap.ko 2024-01-24T15:15:17.028 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/802/stp.ko 2024-01-24T15:15:17.028 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/8021q 2024-01-24T15:15:17.028 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/8021q/8021q.ko 2024-01-24T15:15:17.028 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/9p 2024-01-24T15:15:17.028 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/9p/9pnet.ko 2024-01-24T15:15:17.028 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/9p/9pnet_fd.ko 2024-01-24T15:15:17.028 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/9p/9pnet_rdma.ko 2024-01-24T15:15:17.028 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/9p/9pnet_virtio.ko 2024-01-24T15:15:17.028 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/batman-adv 2024-01-24T15:15:17.028 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/batman-adv/batman-adv.ko 2024-01-24T15:15:17.028 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge 2024-01-24T15:15:17.029 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/br_netfilter.ko 2024-01-24T15:15:17.029 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/bridge.ko 2024-01-24T15:15:17.029 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter 2024-01-24T15:15:17.029 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-24T15:15:17.029 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-24T15:15:17.029 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-24T15:15:17.029 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-24T15:15:17.029 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-24T15:15:17.029 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-24T15:15:17.029 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-24T15:15:17.029 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-24T15:15:17.029 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-24T15:15:17.029 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-24T15:15:17.029 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-24T15:15:17.029 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-24T15:15:17.030 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-24T15:15:17.030 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-24T15:15:17.030 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-24T15:15:17.030 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-24T15:15:17.030 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-24T15:15:17.030 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-24T15:15:17.030 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-24T15:15:17.030 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-24T15:15:17.030 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebtables.ko 2024-01-24T15:15:17.030 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-01-24T15:15:17.030 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-24T15:15:17.030 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-24T15:15:17.030 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ceph 2024-01-24T15:15:17.030 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ceph/libceph.ko 2024-01-24T15:15:17.031 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/core 2024-01-24T15:15:17.031 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/core/failover.ko 2024-01-24T15:15:17.031 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/core/pktgen.ko 2024-01-24T15:15:17.031 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dccp 2024-01-24T15:15:17.031 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/dccp.ko 2024-01-24T15:15:17.031 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/dccp_diag.ko 2024-01-24T15:15:17.031 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/dccp_ipv4.ko 2024-01-24T15:15:17.031 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/dccp_ipv6.ko 2024-01-24T15:15:17.031 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dns_resolver 2024-01-24T15:15:17.031 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dns_resolver/dns_resolver.ko 2024-01-24T15:15:17.031 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dsa 2024-01-24T15:15:17.031 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/dsa_core.ko 2024-01-24T15:15:17.031 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/tag_brcm.ko 2024-01-24T15:15:17.031 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/tag_dsa.ko 2024-01-24T15:15:17.031 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/tag_none.ko 2024-01-24T15:15:17.032 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/tag_trailer.ko 2024-01-24T15:15:17.032 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154 2024-01-24T15:15:17.032 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/6lowpan 2024-01-24T15:15:17.032 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-24T15:15:17.032 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/ieee802154.ko 2024-01-24T15:15:17.032 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-24T15:15:17.032 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4 2024-01-24T15:15:17.032 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ah4.ko 2024-01-24T15:15:17.032 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/esp4.ko 2024-01-24T15:15:17.032 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/fou.ko 2024-01-24T15:15:17.032 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/gre.ko 2024-01-24T15:15:17.032 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/inet_diag.ko 2024-01-24T15:15:17.032 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ip_gre.ko 2024-01-24T15:15:17.033 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ip_tunnel.ko 2024-01-24T15:15:17.033 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ip_vti.ko 2024-01-24T15:15:17.033 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ipcomp.ko 2024-01-24T15:15:17.033 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ipip.ko 2024-01-24T15:15:17.033 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter 2024-01-24T15:15:17.033 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-24T15:15:17.033 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-24T15:15:17.033 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-24T15:15:17.033 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-24T15:15:17.033 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-24T15:15:17.033 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-24T15:15:17.033 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-24T15:15:17.033 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-24T15:15:17.033 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-24T15:15:17.033 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-24T15:15:17.034 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-24T15:15:17.034 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-24T15:15:17.034 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-24T15:15:17.034 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-24T15:15:17.034 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-24T15:15:17.034 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-24T15:15:17.034 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-24T15:15:17.034 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-24T15:15:17.034 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-24T15:15:17.034 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-24T15:15:17.034 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-24T15:15:17.034 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_bic.ko 2024-01-24T15:15:17.034 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_dctcp.ko 2024-01-24T15:15:17.034 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_diag.ko 2024-01-24T15:15:17.034 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_highspeed.ko 2024-01-24T15:15:17.035 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_htcp.ko 2024-01-24T15:15:17.035 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_hybla.ko 2024-01-24T15:15:17.035 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_illinois.ko 2024-01-24T15:15:17.035 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_lp.ko 2024-01-24T15:15:17.035 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_scalable.ko 2024-01-24T15:15:17.035 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_vegas.ko 2024-01-24T15:15:17.035 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_veno.ko 2024-01-24T15:15:17.035 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_westwood.ko 2024-01-24T15:15:17.035 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_yeah.ko 2024-01-24T15:15:17.035 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tunnel4.ko 2024-01-24T15:15:17.035 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/udp_diag.ko 2024-01-24T15:15:17.035 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/udp_tunnel.ko 2024-01-24T15:15:17.035 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-24T15:15:17.035 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6 2024-01-24T15:15:17.036 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ah6.ko 2024-01-24T15:15:17.036 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/esp6.ko 2024-01-24T15:15:17.036 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/fou6.ko 2024-01-24T15:15:17.036 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ip6_tunnel.ko 2024-01-24T15:15:17.036 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-24T15:15:17.036 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ip6_vti.ko 2024-01-24T15:15:17.036 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ipcomp6.ko 2024-01-24T15:15:17.036 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter 2024-01-24T15:15:17.036 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-24T15:15:17.036 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-24T15:15:17.036 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-24T15:15:17.036 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-24T15:15:17.036 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-24T15:15:17.036 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-24T15:15:17.037 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-24T15:15:17.037 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-24T15:15:17.037 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-24T15:15:17.037 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-24T15:15:17.037 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-24T15:15:17.037 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-24T15:15:17.037 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-24T15:15:17.037 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-24T15:15:17.037 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-24T15:15:17.037 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-24T15:15:17.037 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-24T15:15:17.037 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-24T15:15:17.037 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-24T15:15:17.037 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-24T15:15:17.037 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-24T15:15:17.037 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-24T15:15:17.038 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-24T15:15:17.038 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-24T15:15:17.038 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/sit.ko 2024-01-24T15:15:17.038 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/tunnel6.ko 2024-01-24T15:15:17.038 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-24T15:15:17.038 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/key 2024-01-24T15:15:17.038 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/key/af_key.ko 2024-01-24T15:15:17.038 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp 2024-01-24T15:15:17.038 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_core.ko 2024-01-24T15:15:17.038 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-24T15:15:17.038 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_eth.ko 2024-01-24T15:15:17.038 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_ip.ko 2024-01-24T15:15:17.038 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_ip6.ko 2024-01-24T15:15:17.039 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_netlink.ko 2024-01-24T15:15:17.039 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_ppp.ko 2024-01-24T15:15:17.039 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/llc 2024-01-24T15:15:17.039 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/llc/llc.ko 2024-01-24T15:15:17.039 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/mac802154 2024-01-24T15:15:17.039 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/mac802154/mac802154.ko 2024-01-24T15:15:17.039 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/mpls 2024-01-24T15:15:17.039 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/mpls/mpls_gso.ko 2024-01-24T15:15:17.039 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter 2024-01-24T15:15:17.039 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset 2024-01-24T15:15:17.039 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set.ko 2024-01-24T15:15:17.039 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-24T15:15:17.039 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-24T15:15:17.039 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-24T15:15:17.039 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-24T15:15:17.039 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-24T15:15:17.040 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-24T15:15:17.040 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-24T15:15:17.040 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-24T15:15:17.040 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-24T15:15:17.040 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-24T15:15:17.040 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-24T15:15:17.040 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-24T15:15:17.040 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-24T15:15:17.040 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-24T15:15:17.040 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-24T15:15:17.040 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs 2024-01-24T15:15:17.040 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-24T15:15:17.040 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-24T15:15:17.041 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-24T15:15:17.041 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-24T15:15:17.041 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-24T15:15:17.041 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-24T15:15:17.041 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-24T15:15:17.041 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-24T15:15:17.041 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-24T15:15:17.041 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-24T15:15:17.041 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-24T15:15:17.041 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-24T15:15:17.041 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-24T15:15:17.041 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-24T15:15:17.041 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conncount.ko 2024-01-24T15:15:17.041 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack.ko 2024-01-24T15:15:17.041 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-24T15:15:17.041 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-24T15:15:17.042 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-24T15:15:17.042 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-24T15:15:17.042 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-24T15:15:17.042 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-24T15:15:17.042 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-24T15:15:17.042 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-24T15:15:17.042 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-24T15:15:17.042 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-24T15:15:17.042 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-24T15:15:17.042 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-24T15:15:17.042 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-24T15:15:17.042 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_flow_table.ko 2024-01-24T15:15:17.042 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-24T15:15:17.042 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_log_syslog.ko 2024-01-24T15:15:17.042 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat.ko 2024-01-24T15:15:17.043 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-24T15:15:17.043 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-24T15:15:17.043 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_irc.ko 2024-01-24T15:15:17.043 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_sip.ko 2024-01-24T15:15:17.043 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-24T15:15:17.043 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-24T15:15:17.043 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_tables.ko 2024-01-24T15:15:17.043 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink.ko 2024-01-24T15:15:17.043 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-24T15:15:17.043 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_log.ko 2024-01-24T15:15:17.043 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-24T15:15:17.043 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-24T15:15:17.043 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_chain_nat.ko 2024-01-24T15:15:17.043 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_compat.ko 2024-01-24T15:15:17.043 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_ct.ko 2024-01-24T15:15:17.044 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-24T15:15:17.044 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_fib.ko 2024-01-24T15:15:17.044 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-24T15:15:17.044 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_hash.ko 2024-01-24T15:15:17.044 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_limit.ko 2024-01-24T15:15:17.044 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_log.ko 2024-01-24T15:15:17.044 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_masq.ko 2024-01-24T15:15:17.044 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_nat.ko 2024-01-24T15:15:17.044 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_numgen.ko 2024-01-24T15:15:17.044 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_queue.ko 2024-01-24T15:15:17.044 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_quota.ko 2024-01-24T15:15:17.044 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_redir.ko 2024-01-24T15:15:17.044 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_reject.ko 2024-01-24T15:15:17.045 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_reject_inet.ko 2024-01-24T15:15:17.045 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_socket.ko 2024-01-24T15:15:17.045 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_tunnel.ko 2024-01-24T15:15:17.045 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_AUDIT.ko 2024-01-24T15:15:17.045 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-24T15:15:17.045 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-24T15:15:17.045 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-24T15:15:17.045 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_CT.ko 2024-01-24T15:15:17.045 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_DSCP.ko 2024-01-24T15:15:17.045 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_HL.ko 2024-01-24T15:15:17.045 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_HMARK.ko 2024-01-24T15:15:17.045 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-24T15:15:17.045 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_LED.ko 2024-01-24T15:15:17.045 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_LOG.ko 2024-01-24T15:15:17.045 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-24T15:15:17.046 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_NETMAP.ko 2024-01-24T15:15:17.046 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_NFLOG.ko 2024-01-24T15:15:17.046 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-24T15:15:17.046 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_RATEEST.ko 2024-01-24T15:15:17.046 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-24T15:15:17.046 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_SECMARK.ko 2024-01-24T15:15:17.046 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-24T15:15:17.046 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-24T15:15:17.046 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TEE.ko 2024-01-24T15:15:17.046 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TPROXY.ko 2024-01-24T15:15:17.046 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TRACE.ko 2024-01-24T15:15:17.046 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_addrtype.ko 2024-01-24T15:15:17.046 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_bpf.ko 2024-01-24T15:15:17.046 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_cgroup.ko 2024-01-24T15:15:17.046 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_cluster.ko 2024-01-24T15:15:17.046 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_comment.ko 2024-01-24T15:15:17.047 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_connbytes.ko 2024-01-24T15:15:17.047 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_connlabel.ko 2024-01-24T15:15:17.047 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_connlimit.ko 2024-01-24T15:15:17.047 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_connmark.ko 2024-01-24T15:15:17.047 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_conntrack.ko 2024-01-24T15:15:17.047 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_cpu.ko 2024-01-24T15:15:17.047 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_dccp.ko 2024-01-24T15:15:17.047 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_devgroup.ko 2024-01-24T15:15:17.047 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_dscp.ko 2024-01-24T15:15:17.047 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_ecn.ko 2024-01-24T15:15:17.047 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_esp.ko 2024-01-24T15:15:17.047 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_hashlimit.ko 2024-01-24T15:15:17.047 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_helper.ko 2024-01-24T15:15:17.047 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_hl.ko 2024-01-24T15:15:17.047 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_ipcomp.ko 2024-01-24T15:15:17.048 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_iprange.ko 2024-01-24T15:15:17.048 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_ipvs.ko 2024-01-24T15:15:17.048 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_l2tp.ko 2024-01-24T15:15:17.048 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_length.ko 2024-01-24T15:15:17.048 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_limit.ko 2024-01-24T15:15:17.048 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_mac.ko 2024-01-24T15:15:17.048 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_mark.ko 2024-01-24T15:15:17.048 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_multiport.ko 2024-01-24T15:15:17.048 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_nat.ko 2024-01-24T15:15:17.048 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_nfacct.ko 2024-01-24T15:15:17.048 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_osf.ko 2024-01-24T15:15:17.048 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_owner.ko 2024-01-24T15:15:17.048 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_physdev.ko 2024-01-24T15:15:17.048 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_pkttype.ko 2024-01-24T15:15:17.049 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_policy.ko 2024-01-24T15:15:17.049 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_quota.ko 2024-01-24T15:15:17.049 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_rateest.ko 2024-01-24T15:15:17.049 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_realm.ko 2024-01-24T15:15:17.049 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_recent.ko 2024-01-24T15:15:17.049 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_sctp.ko 2024-01-24T15:15:17.049 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_set.ko 2024-01-24T15:15:17.049 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_socket.ko 2024-01-24T15:15:17.049 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_state.ko 2024-01-24T15:15:17.049 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_statistic.ko 2024-01-24T15:15:17.049 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_string.ko 2024-01-24T15:15:17.049 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_tcpmss.ko 2024-01-24T15:15:17.049 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_time.ko 2024-01-24T15:15:17.049 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_u32.ko 2024-01-24T15:15:17.049 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netlink 2024-01-24T15:15:17.050 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netlink/netlink_diag.ko 2024-01-24T15:15:17.050 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/nsh 2024-01-24T15:15:17.050 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/nsh/nsh.ko 2024-01-24T15:15:17.050 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch 2024-01-24T15:15:17.050 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/openvswitch.ko 2024-01-24T15:15:17.050 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/vport-geneve.ko 2024-01-24T15:15:17.050 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/vport-gre.ko 2024-01-24T15:15:17.050 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/vport-vxlan.ko 2024-01-24T15:15:17.050 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/packet 2024-01-24T15:15:17.050 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/packet/af_packet_diag.ko 2024-01-24T15:15:17.050 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/rds 2024-01-24T15:15:17.050 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/rds/rds.ko 2024-01-24T15:15:17.050 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/rds/rds_rdma.ko 2024-01-24T15:15:17.050 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/rds/rds_tcp.ko 2024-01-24T15:15:17.050 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched 2024-01-24T15:15:17.051 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_csum.ko 2024-01-24T15:15:17.051 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_gact.ko 2024-01-24T15:15:17.051 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_ipt.ko 2024-01-24T15:15:17.051 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_mirred.ko 2024-01-24T15:15:17.051 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_nat.ko 2024-01-24T15:15:17.051 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_pedit.ko 2024-01-24T15:15:17.051 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_police.ko 2024-01-24T15:15:17.051 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_simple.ko 2024-01-24T15:15:17.051 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_skbedit.ko 2024-01-24T15:15:17.051 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_vlan.ko 2024-01-24T15:15:17.051 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_basic.ko 2024-01-24T15:15:17.051 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_bpf.ko 2024-01-24T15:15:17.051 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_flow.ko 2024-01-24T15:15:17.051 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_fw.ko 2024-01-24T15:15:17.052 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_route.ko 2024-01-24T15:15:17.052 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_u32.ko 2024-01-24T15:15:17.052 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_cmp.ko 2024-01-24T15:15:17.052 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_ipset.ko 2024-01-24T15:15:17.052 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_meta.ko 2024-01-24T15:15:17.052 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_nbyte.ko 2024-01-24T15:15:17.052 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_text.ko 2024-01-24T15:15:17.052 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_u32.ko 2024-01-24T15:15:17.052 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_choke.ko 2024-01-24T15:15:17.052 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_codel.ko 2024-01-24T15:15:17.052 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_drr.ko 2024-01-24T15:15:17.052 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_fq.ko 2024-01-24T15:15:17.052 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_gred.ko 2024-01-24T15:15:17.052 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_hfsc.ko 2024-01-24T15:15:17.053 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_hhf.ko 2024-01-24T15:15:17.053 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_htb.ko 2024-01-24T15:15:17.053 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_ingress.ko 2024-01-24T15:15:17.053 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_mqprio.ko 2024-01-24T15:15:17.053 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_mqprio_lib.ko 2024-01-24T15:15:17.053 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_multiq.ko 2024-01-24T15:15:17.053 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_netem.ko 2024-01-24T15:15:17.053 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_pie.ko 2024-01-24T15:15:17.053 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_plug.ko 2024-01-24T15:15:17.053 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_prio.ko 2024-01-24T15:15:17.053 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_qfq.ko 2024-01-24T15:15:17.053 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_red.ko 2024-01-24T15:15:17.053 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_sfb.ko 2024-01-24T15:15:17.053 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_sfq.ko 2024-01-24T15:15:17.053 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_tbf.ko 2024-01-24T15:15:17.054 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_teql.ko 2024-01-24T15:15:17.054 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sctp 2024-01-24T15:15:17.054 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sctp/sctp.ko 2024-01-24T15:15:17.054 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sctp/sctp_diag.ko 2024-01-24T15:15:17.054 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc 2024-01-24T15:15:17.054 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/auth_gss 2024-01-24T15:15:17.054 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-24T15:15:17.054 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-24T15:15:17.054 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/sunrpc.ko 2024-01-24T15:15:17.054 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/xprtrdma 2024-01-24T15:15:17.054 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-24T15:15:17.054 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/tipc 2024-01-24T15:15:17.054 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/tipc/diag.ko 2024-01-24T15:15:17.054 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/tipc/tipc.ko 2024-01-24T15:15:17.054 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/unix 2024-01-24T15:15:17.055 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/unix/unix_diag.ko 2024-01-24T15:15:17.055 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock 2024-01-24T15:15:17.055 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-24T15:15:17.055 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-24T15:15:17.055 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vsock.ko 2024-01-24T15:15:17.055 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-24T15:15:17.055 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-24T15:15:17.055 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/xfrm 2024-01-24T15:15:17.055 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-24T15:15:17.055 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/security 2024-01-24T15:15:17.055 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/security/keys 2024-01-24T15:15:17.055 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/security/keys/encrypted-keys 2024-01-24T15:15:17.055 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-01-24T15:15:17.055 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/security/keys/trusted-keys 2024-01-24T15:15:17.056 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/security/keys/trusted-keys/trusted.ko 2024-01-24T15:15:17.056 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/virt 2024-01-24T15:15:17.056 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/virt/lib 2024-01-24T15:15:17.056 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/virt/lib/irqbypass.ko 2024-01-24T15:15:17.056 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/modules.alias 2024-01-24T15:15:17.056 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/modules.alias.bin 2024-01-24T15:15:17.056 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/modules.builtin 2024-01-24T15:15:17.056 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/modules.builtin.bin 2024-01-24T15:15:17.056 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/modules.builtin.modinfo 2024-01-24T15:15:17.056 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/modules.dep 2024-01-24T15:15:17.056 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/modules.dep.bin 2024-01-24T15:15:17.056 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/modules.devname 2024-01-24T15:15:17.056 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/modules.order 2024-01-24T15:15:17.056 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/modules.softdep 2024-01-24T15:15:17.056 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/modules.symbols 2024-01-24T15:15:17.057 INFO:teuthology.orchestra.run.smithi005.stdout:/lib/modules/6.7.0-gf2d346040895/modules.symbols.bin 2024-01-24T15:15:17.057 DEBUG:teuthology.task.kernel:get_image_version: 6.7.0-gf2d346040895 2024-01-24T15:15:17.057 DEBUG:teuthology.orchestra.run.smithi005:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-01-24T15:15:17.087 INFO:teuthology.orchestra.run.smithi005.stdout:postinstall scriptlet (using /bin/sh): 2024-01-24T15:15:17.087 INFO:teuthology.orchestra.run.smithi005.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.7.0-gf2d346040895 -a -r /boot/System.map-6.7.0-gf2d346040895 ]; then 2024-01-24T15:15:17.087 INFO:teuthology.orchestra.run.smithi005.stdout:cp /boot/vmlinuz-6.7.0-gf2d346040895 /boot/.vmlinuz-6.7.0-gf2d346040895-rpm 2024-01-24T15:15:17.087 INFO:teuthology.orchestra.run.smithi005.stdout:cp /boot/System.map-6.7.0-gf2d346040895 /boot/.System.map-6.7.0-gf2d346040895-rpm 2024-01-24T15:15:17.087 INFO:teuthology.orchestra.run.smithi005.stdout:rm -f /boot/vmlinuz-6.7.0-gf2d346040895 /boot/System.map-6.7.0-gf2d346040895 2024-01-24T15:15:17.088 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/installkernel 6.7.0-gf2d346040895 /boot/.vmlinuz-6.7.0-gf2d346040895-rpm /boot/.System.map-6.7.0-gf2d346040895-rpm 2024-01-24T15:15:17.088 INFO:teuthology.orchestra.run.smithi005.stdout:rm -f /boot/.vmlinuz-6.7.0-gf2d346040895-rpm /boot/.System.map-6.7.0-gf2d346040895-rpm 2024-01-24T15:15:17.088 INFO:teuthology.orchestra.run.smithi005.stdout:fi 2024-01-24T15:15:17.088 INFO:teuthology.orchestra.run.smithi005.stdout:preuninstall scriptlet (using /bin/sh): 2024-01-24T15:15:17.088 INFO:teuthology.orchestra.run.smithi005.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-01-24T15:15:17.088 INFO:teuthology.orchestra.run.smithi005.stdout:new-kernel-pkg --remove 6.7.0-gf2d346040895 --rminitrd --initrdfile=/boot/initramfs-6.7.0-gf2d346040895.img 2024-01-24T15:15:17.088 INFO:teuthology.orchestra.run.smithi005.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-01-24T15:15:17.088 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-install remove 6.7.0-gf2d346040895 2024-01-24T15:15:17.088 INFO:teuthology.orchestra.run.smithi005.stdout:fi 2024-01-24T15:15:17.088 INFO:teuthology.orchestra.run.smithi005.stdout:postuninstall scriptlet (using /bin/sh): 2024-01-24T15:15:17.088 INFO:teuthology.orchestra.run.smithi005.stdout:if [ -x /sbin/update-bootloader ]; then 2024-01-24T15:15:17.089 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/update-bootloader --remove 6.7.0-gf2d346040895 2024-01-24T15:15:17.089 INFO:teuthology.orchestra.run.smithi005.stdout:fi 2024-01-24T15:15:17.090 DEBUG:teuthology.orchestra.run.smithi005:> sudo rpm -qi grub2-tools 2024-01-24T15:15:17.173 INFO:teuthology.orchestra.run.smithi005.stdout:Name : grub2-tools 2024-01-24T15:15:17.173 INFO:teuthology.orchestra.run.smithi005.stdout:Epoch : 1 2024-01-24T15:15:17.173 INFO:teuthology.orchestra.run.smithi005.stdout:Version : 2.02 2024-01-24T15:15:17.173 INFO:teuthology.orchestra.run.smithi005.stdout:Release : 123.el8 2024-01-24T15:15:17.173 INFO:teuthology.orchestra.run.smithi005.stdout:Architecture: x86_64 2024-01-24T15:15:17.173 INFO:teuthology.orchestra.run.smithi005.stdout:Install Date: Thu 14 Dec 2023 12:39:42 AM UTC 2024-01-24T15:15:17.173 INFO:teuthology.orchestra.run.smithi005.stdout:Group : System Environment/Base 2024-01-24T15:15:17.174 INFO:teuthology.orchestra.run.smithi005.stdout:Size : 9265450 2024-01-24T15:15:17.174 INFO:teuthology.orchestra.run.smithi005.stdout:License : GPLv3+ 2024-01-24T15:15:17.174 INFO:teuthology.orchestra.run.smithi005.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2024-01-24T15:15:17.174 INFO:teuthology.orchestra.run.smithi005.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2024-01-24T15:15:17.174 INFO:teuthology.orchestra.run.smithi005.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2024-01-24T15:15:17.174 INFO:teuthology.orchestra.run.smithi005.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2024-01-24T15:15:17.174 INFO:teuthology.orchestra.run.smithi005.stdout:Relocations : (not relocatable) 2024-01-24T15:15:17.174 INFO:teuthology.orchestra.run.smithi005.stdout:Packager : Red Hat, Inc. 2024-01-24T15:15:17.174 INFO:teuthology.orchestra.run.smithi005.stdout:Vendor : Red Hat, Inc. 2024-01-24T15:15:17.174 INFO:teuthology.orchestra.run.smithi005.stdout:URL : http://www.gnu.org/software/grub/ 2024-01-24T15:15:17.174 INFO:teuthology.orchestra.run.smithi005.stdout:Summary : Support tools for GRUB. 2024-01-24T15:15:17.174 INFO:teuthology.orchestra.run.smithi005.stdout:Description : 2024-01-24T15:15:17.174 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:15:17.174 INFO:teuthology.orchestra.run.smithi005.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-01-24T15:15:17.175 INFO:teuthology.orchestra.run.smithi005.stdout:customizable bootloader with modular architecture. It supports a rich 2024-01-24T15:15:17.175 INFO:teuthology.orchestra.run.smithi005.stdout:variety of kernel formats, file systems, computer architectures and 2024-01-24T15:15:17.175 INFO:teuthology.orchestra.run.smithi005.stdout:hardware devices. 2024-01-24T15:15:17.175 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:15:17.175 INFO:teuthology.orchestra.run.smithi005.stdout:This subpackage provides tools for support of all platforms. 2024-01-24T15:15:17.176 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-01-24T15:15:17.176 INFO:teuthology.task.kernel:Updating grub on smithi005 to boot 6.7.0-gf2d346040895 2024-01-24T15:15:17.176 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-01-24T15:15:17.952 INFO:teuthology.orchestra.run.smithi005.stderr:Generating grub configuration file ... 2024-01-24T15:15:20.277 INFO:teuthology.orchestra.run.smithi005.stderr:done 2024-01-24T15:15:20.280 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-01-24T15:15:20.350 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.wmWk0fV5b2 2024-01-24T15:15:20.351 DEBUG:teuthology.orchestra.run.smithi005:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.wmWk0fV5b2 2024-01-24T15:15:20.430 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.wmWk0fV5b2 2024-01-24T15:15:20.595 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.wmWk0fV5b2 is 6KB 2024-01-24T15:15:20.622 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.wmWk0fV5b2 2024-01-24T15:15:20.643 DEBUG:teuthology.orchestra.run.smithi005:> sudo /bin/ls /boot/loader/entries || true 2024-01-24T15:15:20.715 INFO:teuthology.orchestra.run.smithi005.stdout:2db68f91c8f90721a6596efe657a5324-0-rescue.conf 2024-01-24T15:15:20.715 INFO:teuthology.orchestra.run.smithi005.stdout:2db68f91c8f90721a6596efe657a5324-6.7.0-gf2d346040895.conf 2024-01-24T15:15:20.715 INFO:teuthology.orchestra.run.smithi005.stdout:963f8b6c99184de696879b3f7da9ecce-0-rescue.conf 2024-01-24T15:15:20.715 INFO:teuthology.orchestra.run.smithi005.stdout:963f8b6c99184de696879b3f7da9ecce-4.18.0-372.9.1.el8.x86_64.conf 2024-01-24T15:15:20.715 INFO:teuthology.orchestra.run.smithi005.stdout:963f8b6c99184de696879b3f7da9ecce-4.18.0-513.9.1.el8_9.x86_64.conf 2024-01-24T15:15:20.717 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-set-default 2db68f91c8f90721a6596efe657a5324-6.7.0-gf2d346040895 2024-01-24T15:15:20.911 DEBUG:teuthology.orchestra.run.smithi005:> sudo shutdown -r now 2024-01-24T15:15:28.520 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi204.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-01-24T15:15:28.520 DEBUG:teuthology.orchestra.run.smithi204:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-01-24T15:15:28.579 INFO:teuthology.orchestra.run.smithi204.stdout:/boot/System.map-6.7.0-gf2d346040895 2024-01-24T15:15:28.579 INFO:teuthology.orchestra.run.smithi204.stdout:/boot/config-6.7.0-gf2d346040895 2024-01-24T15:15:28.579 INFO:teuthology.orchestra.run.smithi204.stdout:/boot/vmlinuz-6.7.0-gf2d346040895 2024-01-24T15:15:28.580 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895 2024-01-24T15:15:28.580 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel 2024-01-24T15:15:28.580 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch 2024-01-24T15:15:28.580 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86 2024-01-24T15:15:28.580 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto 2024-01-24T15:15:28.580 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-24T15:15:28.580 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-24T15:15:28.580 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-24T15:15:28.580 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-24T15:15:28.580 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-24T15:15:28.580 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-24T15:15:28.580 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-24T15:15:28.580 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/crc32c-intel.ko 2024-01-24T15:15:28.581 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-24T15:15:28.581 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-24T15:15:28.581 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-24T15:15:28.581 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-24T15:15:28.581 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-24T15:15:28.581 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-24T15:15:28.581 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-24T15:15:28.581 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-24T15:15:28.581 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-24T15:15:28.581 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-24T15:15:28.581 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-24T15:15:28.581 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-24T15:15:28.581 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel 2024-01-24T15:15:28.581 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/cpu 2024-01-24T15:15:28.581 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/cpu/mce 2024-01-24T15:15:28.582 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-24T15:15:28.582 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kvm 2024-01-24T15:15:28.582 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-24T15:15:28.582 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-24T15:15:28.582 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kvm/kvm.ko 2024-01-24T15:15:28.582 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto 2024-01-24T15:15:28.582 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/ansi_cprng.ko 2024-01-24T15:15:28.582 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/anubis.ko 2024-01-24T15:15:28.582 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/arc4.ko 2024-01-24T15:15:28.582 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx 2024-01-24T15:15:28.582 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_memcpy.ko 2024-01-24T15:15:28.582 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_pq.ko 2024-01-24T15:15:28.582 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-24T15:15:28.582 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_tx.ko 2024-01-24T15:15:28.582 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_xor.ko 2024-01-24T15:15:28.583 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/raid6test.ko 2024-01-24T15:15:28.583 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/authenc.ko 2024-01-24T15:15:28.583 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/authencesn.ko 2024-01-24T15:15:28.583 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/blake2b_generic.ko 2024-01-24T15:15:28.583 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/blowfish_common.ko 2024-01-24T15:15:28.583 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/blowfish_generic.ko 2024-01-24T15:15:28.583 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/camellia_generic.ko 2024-01-24T15:15:28.583 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/cast5_generic.ko 2024-01-24T15:15:28.583 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/cast6_generic.ko 2024-01-24T15:15:28.583 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/cast_common.ko 2024-01-24T15:15:28.583 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/ccm.ko 2024-01-24T15:15:28.583 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/cmac.ko 2024-01-24T15:15:28.583 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/crc32_generic.ko 2024-01-24T15:15:28.583 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/crypto_engine.ko 2024-01-24T15:15:28.583 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/crypto_user.ko 2024-01-24T15:15:28.584 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/cts.ko 2024-01-24T15:15:28.584 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/des_generic.ko 2024-01-24T15:15:28.584 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/dh_generic.ko 2024-01-24T15:15:28.584 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/echainiv.ko 2024-01-24T15:15:28.584 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/essiv.ko 2024-01-24T15:15:28.584 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/fcrypt.ko 2024-01-24T15:15:28.584 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/khazad.ko 2024-01-24T15:15:28.584 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/lz4.ko 2024-01-24T15:15:28.584 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/lz4hc.ko 2024-01-24T15:15:28.584 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/md4.ko 2024-01-24T15:15:28.584 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/michael_mic.ko 2024-01-24T15:15:28.584 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/pcbc.ko 2024-01-24T15:15:28.584 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/pcrypt.ko 2024-01-24T15:15:28.584 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/rmd160.ko 2024-01-24T15:15:28.585 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/seed.ko 2024-01-24T15:15:28.585 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/serpent_generic.ko 2024-01-24T15:15:28.585 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/tcrypt.ko 2024-01-24T15:15:28.585 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/tea.ko 2024-01-24T15:15:28.585 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/twofish_common.ko 2024-01-24T15:15:28.585 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/twofish_generic.ko 2024-01-24T15:15:28.585 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/vmac.ko 2024-01-24T15:15:28.585 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/wp512.ko 2024-01-24T15:15:28.585 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/xcbc.ko 2024-01-24T15:15:28.585 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/xor.ko 2024-01-24T15:15:28.585 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/xxhash_generic.ko 2024-01-24T15:15:28.585 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers 2024-01-24T15:15:28.585 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi 2024-01-24T15:15:28.585 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-24T15:15:28.585 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/acpi_pad.ko 2024-01-24T15:15:28.586 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/custom_method.ko 2024-01-24T15:15:28.586 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/ec_sys.ko 2024-01-24T15:15:28.586 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/platform_profile.ko 2024-01-24T15:15:28.586 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/sbs.ko 2024-01-24T15:15:28.586 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/sbshc.ko 2024-01-24T15:15:28.586 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/video.ko 2024-01-24T15:15:28.586 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata 2024-01-24T15:15:28.586 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/acard-ahci.ko 2024-01-24T15:15:28.586 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/ahci_platform.ko 2024-01-24T15:15:28.586 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/ata_generic.ko 2024-01-24T15:15:28.586 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/libahci_platform.ko 2024-01-24T15:15:28.586 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_acpi.ko 2024-01-24T15:15:28.586 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_ali.ko 2024-01-24T15:15:28.586 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_amd.ko 2024-01-24T15:15:28.586 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_artop.ko 2024-01-24T15:15:28.587 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_atiixp.ko 2024-01-24T15:15:28.587 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_atp867x.ko 2024-01-24T15:15:28.587 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_cmd640.ko 2024-01-24T15:15:28.587 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_cmd64x.ko 2024-01-24T15:15:28.587 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_cypress.ko 2024-01-24T15:15:28.587 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_efar.ko 2024-01-24T15:15:28.587 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_hpt366.ko 2024-01-24T15:15:28.587 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_hpt37x.ko 2024-01-24T15:15:28.587 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-24T15:15:28.587 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-24T15:15:28.587 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_it8213.ko 2024-01-24T15:15:28.587 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_it821x.ko 2024-01-24T15:15:28.587 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_jmicron.ko 2024-01-24T15:15:28.587 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_marvell.ko 2024-01-24T15:15:28.587 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_mpiix.ko 2024-01-24T15:15:28.588 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_netcell.ko 2024-01-24T15:15:28.588 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_ninja32.ko 2024-01-24T15:15:28.588 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_ns87410.ko 2024-01-24T15:15:28.588 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_ns87415.ko 2024-01-24T15:15:28.588 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_oldpiix.ko 2024-01-24T15:15:28.588 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_opti.ko 2024-01-24T15:15:28.588 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_optidma.ko 2024-01-24T15:15:28.588 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_pcmcia.ko 2024-01-24T15:15:28.588 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-24T15:15:28.588 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-24T15:15:28.588 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_piccolo.ko 2024-01-24T15:15:28.588 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_rdc.ko 2024-01-24T15:15:28.588 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_sch.ko 2024-01-24T15:15:28.589 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_serverworks.ko 2024-01-24T15:15:28.589 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_sil680.ko 2024-01-24T15:15:28.589 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_sis.ko 2024-01-24T15:15:28.589 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_sl82c105.ko 2024-01-24T15:15:28.589 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_triflex.ko 2024-01-24T15:15:28.589 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_via.ko 2024-01-24T15:15:28.589 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pdc_adma.ko 2024-01-24T15:15:28.589 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_inic162x.ko 2024-01-24T15:15:28.589 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_mv.ko 2024-01-24T15:15:28.589 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_nv.ko 2024-01-24T15:15:28.589 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_promise.ko 2024-01-24T15:15:28.589 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_qstor.ko 2024-01-24T15:15:28.589 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_sil.ko 2024-01-24T15:15:28.589 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_sil24.ko 2024-01-24T15:15:28.590 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_sis.ko 2024-01-24T15:15:28.590 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_svw.ko 2024-01-24T15:15:28.590 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_sx4.ko 2024-01-24T15:15:28.590 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_uli.ko 2024-01-24T15:15:28.590 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_via.ko 2024-01-24T15:15:28.590 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_vsc.ko 2024-01-24T15:15:28.590 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/auxdisplay 2024-01-24T15:15:28.590 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/auxdisplay/ks0108.ko 2024-01-24T15:15:28.590 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/base 2024-01-24T15:15:28.590 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/base/regmap 2024-01-24T15:15:28.590 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/base/regmap/regmap-i2c.ko 2024-01-24T15:15:28.590 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/base/regmap/regmap-mmio.ko 2024-01-24T15:15:28.590 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/bcma 2024-01-24T15:15:28.590 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/bcma/bcma.ko 2024-01-24T15:15:28.591 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block 2024-01-24T15:15:28.591 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/aoe 2024-01-24T15:15:28.591 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/aoe/aoe.ko 2024-01-24T15:15:28.591 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/brd.ko 2024-01-24T15:15:28.591 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/drbd 2024-01-24T15:15:28.591 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/drbd/drbd.ko 2024-01-24T15:15:28.591 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/floppy.ko 2024-01-24T15:15:28.591 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/loop.ko 2024-01-24T15:15:28.591 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/mtip32xx 2024-01-24T15:15:28.591 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-24T15:15:28.591 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/nbd.ko 2024-01-24T15:15:28.591 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/null_blk 2024-01-24T15:15:28.591 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/null_blk/null_blk.ko 2024-01-24T15:15:28.591 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/pktcdvd.ko 2024-01-24T15:15:28.592 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/rbd.ko 2024-01-24T15:15:28.592 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/virtio_blk.ko 2024-01-24T15:15:28.592 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/xen-blkback 2024-01-24T15:15:28.592 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-24T15:15:28.592 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/xen-blkfront.ko 2024-01-24T15:15:28.592 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/zram 2024-01-24T15:15:28.592 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/zram/zram.ko 2024-01-24T15:15:28.592 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char 2024-01-24T15:15:28.592 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hangcheck-timer.ko 2024-01-24T15:15:28.592 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random 2024-01-24T15:15:28.592 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-24T15:15:28.592 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-24T15:15:28.592 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-24T15:15:28.592 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/via-rng.ko 2024-01-24T15:15:28.592 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-24T15:15:28.593 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi 2024-01-24T15:15:28.593 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-24T15:15:28.593 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-24T15:15:28.593 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-24T15:15:28.593 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-24T15:15:28.593 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-24T15:15:28.593 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-24T15:15:28.593 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/lp.ko 2024-01-24T15:15:28.593 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/mwave 2024-01-24T15:15:28.593 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/mwave/mwave.ko 2024-01-24T15:15:28.593 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ppdev.ko 2024-01-24T15:15:28.593 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tlclk.ko 2024-01-24T15:15:28.593 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm 2024-01-24T15:15:28.594 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm.ko 2024-01-24T15:15:28.594 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-24T15:15:28.594 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-24T15:15:28.594 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-24T15:15:28.594 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_tis.ko 2024-01-24T15:15:28.594 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-01-24T15:15:28.594 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/uv_mmtimer.ko 2024-01-24T15:15:28.594 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/virtio_console.ko 2024-01-24T15:15:28.594 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq 2024-01-24T15:15:28.594 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-01-24T15:15:28.594 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-24T15:15:28.594 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-24T15:15:28.594 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-01-24T15:15:28.594 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/powernow-k8.ko 2024-01-24T15:15:28.595 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-24T15:15:28.595 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto 2024-01-24T15:15:28.595 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/ccp 2024-01-24T15:15:28.595 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-24T15:15:28.595 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/ccp/ccp.ko 2024-01-24T15:15:28.595 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel 2024-01-24T15:15:28.595 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat 2024-01-24T15:15:28.595 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/qat_common 2024-01-24T15:15:28.595 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-24T15:15:28.595 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-01-24T15:15:28.595 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-24T15:15:28.595 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/padlock-aes.ko 2024-01-24T15:15:28.595 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/padlock-sha.ko 2024-01-24T15:15:28.595 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/virtio 2024-01-24T15:15:28.595 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-24T15:15:28.596 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/dca 2024-01-24T15:15:28.596 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/dca/dca.ko 2024-01-24T15:15:28.596 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/devfreq 2024-01-24T15:15:28.596 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-01-24T15:15:28.596 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma 2024-01-24T15:15:28.596 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/dw 2024-01-24T15:15:28.596 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-24T15:15:28.596 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/ioat 2024-01-24T15:15:28.596 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-24T15:15:28.596 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac 2024-01-24T15:15:28.596 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/amd64_edac.ko 2024-01-24T15:15:28.596 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/e752x_edac.ko 2024-01-24T15:15:28.596 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/edac_mce_amd.ko 2024-01-24T15:15:28.596 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i3000_edac.ko 2024-01-24T15:15:28.597 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i3200_edac.ko 2024-01-24T15:15:28.597 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i5100_edac.ko 2024-01-24T15:15:28.597 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i5400_edac.ko 2024-01-24T15:15:28.597 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i7300_edac.ko 2024-01-24T15:15:28.597 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i7core_edac.ko 2024-01-24T15:15:28.597 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i82975x_edac.ko 2024-01-24T15:15:28.597 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/ie31200_edac.ko 2024-01-24T15:15:28.597 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/sb_edac.ko 2024-01-24T15:15:28.597 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/x38_edac.ko 2024-01-24T15:15:28.597 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/firmware 2024-01-24T15:15:28.597 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/firmware/edd.ko 2024-01-24T15:15:28.597 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-24T15:15:28.597 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio 2024-01-24T15:15:28.598 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-ich.ko 2024-01-24T15:15:28.598 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-24T15:15:28.598 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid 2024-01-24T15:15:28.598 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-appleir.ko 2024-01-24T15:15:28.598 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-aureal.ko 2024-01-24T15:15:28.598 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-axff.ko 2024-01-24T15:15:28.598 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-dr.ko 2024-01-24T15:15:28.598 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-elecom.ko 2024-01-24T15:15:28.598 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-elo.ko 2024-01-24T15:15:28.598 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-emsff.ko 2024-01-24T15:15:28.598 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-gaff.ko 2024-01-24T15:15:28.598 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-gt683r.ko 2024-01-24T15:15:28.598 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-gyration.ko 2024-01-24T15:15:28.598 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-24T15:15:28.598 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-24T15:15:28.599 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-holtekff.ko 2024-01-24T15:15:28.599 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-hyperv.ko 2024-01-24T15:15:28.599 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-icade.ko 2024-01-24T15:15:28.599 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-keytouch.ko 2024-01-24T15:15:28.599 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-kye.ko 2024-01-24T15:15:28.599 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-lcpower.ko 2024-01-24T15:15:28.599 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-led.ko 2024-01-24T15:15:28.599 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-lenovo.ko 2024-01-24T15:15:28.599 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-24T15:15:28.599 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-24T15:15:28.599 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-multitouch.ko 2024-01-24T15:15:28.599 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-ortek.ko 2024-01-24T15:15:28.599 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-penmount.ko 2024-01-24T15:15:28.599 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-petalynx.ko 2024-01-24T15:15:28.599 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-picolcd.ko 2024-01-24T15:15:28.600 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-pl.ko 2024-01-24T15:15:28.600 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-plantronics.ko 2024-01-24T15:15:28.600 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-primax.ko 2024-01-24T15:15:28.600 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-rmi.ko 2024-01-24T15:15:28.600 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-24T15:15:28.600 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-common.ko 2024-01-24T15:15:28.600 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-24T15:15:28.600 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-24T15:15:28.600 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-24T15:15:28.600 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-24T15:15:28.600 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-24T15:15:28.600 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-24T15:15:28.600 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-24T15:15:28.601 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-24T15:15:28.601 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-24T15:15:28.601 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat.ko 2024-01-24T15:15:28.601 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-saitek.ko 2024-01-24T15:15:28.601 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-samsung.ko 2024-01-24T15:15:28.601 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-24T15:15:28.601 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-sjoy.ko 2024-01-24T15:15:28.601 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-sony.ko 2024-01-24T15:15:28.601 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-speedlink.ko 2024-01-24T15:15:28.601 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-steelseries.ko 2024-01-24T15:15:28.601 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-sunplus.ko 2024-01-24T15:15:28.601 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-24T15:15:28.601 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-tivo.ko 2024-01-24T15:15:28.601 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-tmff.ko 2024-01-24T15:15:28.602 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-topseed.ko 2024-01-24T15:15:28.602 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-twinhan.ko 2024-01-24T15:15:28.602 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-uclogic.ko 2024-01-24T15:15:28.602 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-waltop.ko 2024-01-24T15:15:28.602 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-wiimote.ko 2024-01-24T15:15:28.602 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-xinmo.ko 2024-01-24T15:15:28.602 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-zpff.ko 2024-01-24T15:15:28.602 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-zydacron.ko 2024-01-24T15:15:28.602 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/uhid.ko 2024-01-24T15:15:28.602 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/wacom.ko 2024-01-24T15:15:28.602 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hv 2024-01-24T15:15:28.602 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hv/hv_balloon.ko 2024-01-24T15:15:28.602 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hv/hv_utils.ko 2024-01-24T15:15:28.602 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hv/hv_vmbus.ko 2024-01-24T15:15:28.602 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon 2024-01-24T15:15:28.602 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/abituguru.ko 2024-01-24T15:15:28.603 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/abituguru3.ko 2024-01-24T15:15:28.603 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-24T15:15:28.603 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ad7414.ko 2024-01-24T15:15:28.603 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ad7418.ko 2024-01-24T15:15:28.603 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adc128d818.ko 2024-01-24T15:15:28.603 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm1025.ko 2024-01-24T15:15:28.603 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm1026.ko 2024-01-24T15:15:28.603 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm1029.ko 2024-01-24T15:15:28.603 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm1031.ko 2024-01-24T15:15:28.603 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm9240.ko 2024-01-24T15:15:28.603 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ads7828.ko 2024-01-24T15:15:28.603 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7410.ko 2024-01-24T15:15:28.603 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7411.ko 2024-01-24T15:15:28.603 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7462.ko 2024-01-24T15:15:28.603 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7470.ko 2024-01-24T15:15:28.604 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7475.ko 2024-01-24T15:15:28.604 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7x10.ko 2024-01-24T15:15:28.604 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/amc6821.ko 2024-01-24T15:15:28.604 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/applesmc.ko 2024-01-24T15:15:28.604 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/asb100.ko 2024-01-24T15:15:28.604 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/asc7621.ko 2024-01-24T15:15:28.604 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-24T15:15:28.604 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/atxp1.ko 2024-01-24T15:15:28.604 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/coretemp.ko 2024-01-24T15:15:28.604 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-24T15:15:28.604 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/dme1737.ko 2024-01-24T15:15:28.604 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ds1621.ko 2024-01-24T15:15:28.604 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ds620.ko 2024-01-24T15:15:28.604 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/emc1403.ko 2024-01-24T15:15:28.605 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/emc6w201.ko 2024-01-24T15:15:28.605 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/f71805f.ko 2024-01-24T15:15:28.605 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/f71882fg.ko 2024-01-24T15:15:28.605 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/f75375s.ko 2024-01-24T15:15:28.605 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/fam15h_power.ko 2024-01-24T15:15:28.605 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/fschmd.ko 2024-01-24T15:15:28.605 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/g760a.ko 2024-01-24T15:15:28.605 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/g762.ko 2024-01-24T15:15:28.605 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/gl518sm.ko 2024-01-24T15:15:28.605 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/gl520sm.ko 2024-01-24T15:15:28.605 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-24T15:15:28.605 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/i5500_temp.ko 2024-01-24T15:15:28.605 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/i5k_amb.ko 2024-01-24T15:15:28.605 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ibmaem.ko 2024-01-24T15:15:28.605 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ibmpex.ko 2024-01-24T15:15:28.606 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ina209.ko 2024-01-24T15:15:28.606 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ina2xx.ko 2024-01-24T15:15:28.606 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/it87.ko 2024-01-24T15:15:28.606 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/k10temp.ko 2024-01-24T15:15:28.606 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/k8temp.ko 2024-01-24T15:15:28.606 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lineage-pem.ko 2024-01-24T15:15:28.606 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm63.ko 2024-01-24T15:15:28.606 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm73.ko 2024-01-24T15:15:28.606 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm75.ko 2024-01-24T15:15:28.606 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm77.ko 2024-01-24T15:15:28.606 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm78.ko 2024-01-24T15:15:28.606 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm80.ko 2024-01-24T15:15:28.606 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm83.ko 2024-01-24T15:15:28.606 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm85.ko 2024-01-24T15:15:28.606 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm87.ko 2024-01-24T15:15:28.607 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm90.ko 2024-01-24T15:15:28.607 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm92.ko 2024-01-24T15:15:28.607 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm93.ko 2024-01-24T15:15:28.607 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm95234.ko 2024-01-24T15:15:28.607 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm95241.ko 2024-01-24T15:15:28.607 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm95245.ko 2024-01-24T15:15:28.607 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc2945.ko 2024-01-24T15:15:28.607 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4151.ko 2024-01-24T15:15:28.607 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4215.ko 2024-01-24T15:15:28.607 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4222.ko 2024-01-24T15:15:28.607 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4245.ko 2024-01-24T15:15:28.607 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4260.ko 2024-01-24T15:15:28.607 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4261.ko 2024-01-24T15:15:28.607 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max16065.ko 2024-01-24T15:15:28.607 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max1619.ko 2024-01-24T15:15:28.608 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max1668.ko 2024-01-24T15:15:28.608 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max197.ko 2024-01-24T15:15:28.608 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max6639.ko 2024-01-24T15:15:28.608 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max6650.ko 2024-01-24T15:15:28.608 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max6697.ko 2024-01-24T15:15:28.608 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/mcp3021.ko 2024-01-24T15:15:28.608 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/nct6683.ko 2024-01-24T15:15:28.608 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/nct6775-core.ko 2024-01-24T15:15:28.608 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/nct6775.ko 2024-01-24T15:15:28.608 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/nct7802.ko 2024-01-24T15:15:28.608 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pc87360.ko 2024-01-24T15:15:28.608 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pc87427.ko 2024-01-24T15:15:28.608 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pcf8591.ko 2024-01-24T15:15:28.608 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus 2024-01-24T15:15:28.608 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-24T15:15:28.609 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-24T15:15:28.609 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-24T15:15:28.609 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-24T15:15:28.609 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-24T15:15:28.609 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-24T15:15:28.609 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-24T15:15:28.609 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-24T15:15:28.609 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-24T15:15:28.609 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-24T15:15:28.609 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-24T15:15:28.609 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-24T15:15:28.609 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/powr1220.ko 2024-01-24T15:15:28.609 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sch5627.ko 2024-01-24T15:15:28.609 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sch5636.ko 2024-01-24T15:15:28.609 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-24T15:15:28.610 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sht15.ko 2024-01-24T15:15:28.610 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sht21.ko 2024-01-24T15:15:28.610 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/shtc1.ko 2024-01-24T15:15:28.610 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sis5595.ko 2024-01-24T15:15:28.610 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/smsc47b397.ko 2024-01-24T15:15:28.610 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/smsc47m1.ko 2024-01-24T15:15:28.610 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/smsc47m192.ko 2024-01-24T15:15:28.610 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/thmc50.ko 2024-01-24T15:15:28.610 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/tmp102.ko 2024-01-24T15:15:28.610 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/tmp103.ko 2024-01-24T15:15:28.610 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/tmp401.ko 2024-01-24T15:15:28.610 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/tmp421.ko 2024-01-24T15:15:28.610 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/via-cputemp.ko 2024-01-24T15:15:28.610 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/via686a.ko 2024-01-24T15:15:28.610 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/vt1211.ko 2024-01-24T15:15:28.611 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/vt8231.ko 2024-01-24T15:15:28.611 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83627ehf.ko 2024-01-24T15:15:28.611 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83627hf.ko 2024-01-24T15:15:28.611 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83781d.ko 2024-01-24T15:15:28.611 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83791d.ko 2024-01-24T15:15:28.611 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83792d.ko 2024-01-24T15:15:28.611 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83793.ko 2024-01-24T15:15:28.611 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83795.ko 2024-01-24T15:15:28.611 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83l785ts.ko 2024-01-24T15:15:28.611 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83l786ng.ko 2024-01-24T15:15:28.611 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c 2024-01-24T15:15:28.611 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/algos 2024-01-24T15:15:28.611 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-24T15:15:28.611 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-24T15:15:28.612 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses 2024-01-24T15:15:28.612 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-24T15:15:28.612 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-24T15:15:28.612 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-24T15:15:28.612 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-24T15:15:28.612 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-24T15:15:28.612 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-24T15:15:28.612 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-24T15:15:28.612 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-24T15:15:28.612 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-24T15:15:28.612 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-24T15:15:28.612 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-24T15:15:28.612 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-24T15:15:28.612 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-24T15:15:28.613 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-24T15:15:28.613 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-24T15:15:28.613 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-24T15:15:28.613 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-24T15:15:28.613 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-24T15:15:28.613 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-24T15:15:28.613 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-24T15:15:28.613 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-24T15:15:28.613 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-24T15:15:28.613 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-24T15:15:28.613 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/i2c-dev.ko 2024-01-24T15:15:28.613 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/i2c-mux.ko 2024-01-24T15:15:28.613 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-01-24T15:15:28.613 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/i2c-smbus.ko 2024-01-24T15:15:28.613 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/i2c-stub.ko 2024-01-24T15:15:28.614 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband 2024-01-24T15:15:28.614 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core 2024-01-24T15:15:28.614 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-24T15:15:28.614 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ib_core.ko 2024-01-24T15:15:28.614 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-24T15:15:28.614 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-24T15:15:28.614 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-24T15:15:28.614 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-24T15:15:28.614 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-24T15:15:28.614 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw 2024-01-24T15:15:28.614 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/cxgb4 2024-01-24T15:15:28.614 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-24T15:15:28.614 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mlx4 2024-01-24T15:15:28.614 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-24T15:15:28.614 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mlx5 2024-01-24T15:15:28.615 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-24T15:15:28.615 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mthca 2024-01-24T15:15:28.615 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-24T15:15:28.615 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp 2024-01-24T15:15:28.615 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/ipoib 2024-01-24T15:15:28.615 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-24T15:15:28.615 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/iser 2024-01-24T15:15:28.615 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-24T15:15:28.615 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/isert 2024-01-24T15:15:28.615 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-24T15:15:28.615 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/srp 2024-01-24T15:15:28.615 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-24T15:15:28.615 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/srpt 2024-01-24T15:15:28.615 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-24T15:15:28.616 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input 2024-01-24T15:15:28.616 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/gameport 2024-01-24T15:15:28.616 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-24T15:15:28.616 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-24T15:15:28.616 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/gameport/gameport.ko 2024-01-24T15:15:28.616 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/joydev.ko 2024-01-24T15:15:28.616 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard 2024-01-24T15:15:28.616 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-24T15:15:28.616 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse 2024-01-24T15:15:28.616 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/appletouch.ko 2024-01-24T15:15:28.616 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/bcm5974.ko 2024-01-24T15:15:28.616 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/cyapatp.ko 2024-01-24T15:15:28.616 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-24T15:15:28.616 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/sermouse.ko 2024-01-24T15:15:28.617 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-24T15:15:28.617 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-24T15:15:28.617 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-24T15:15:28.617 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/rmi4 2024-01-24T15:15:28.617 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-24T15:15:28.617 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio 2024-01-24T15:15:28.617 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/altera_ps2.ko 2024-01-24T15:15:28.617 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/arc_ps2.ko 2024-01-24T15:15:28.617 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-24T15:15:28.617 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/serio_raw.ko 2024-01-24T15:15:28.617 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/sparse-keymap.ko 2024-01-24T15:15:28.617 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds 2024-01-24T15:15:28.617 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-blinkm.ko 2024-01-24T15:15:28.617 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-lm3530.ko 2024-01-24T15:15:28.617 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-lp3944.ko 2024-01-24T15:15:28.617 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-ss4200.ko 2024-01-24T15:15:28.618 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger 2024-01-24T15:15:28.618 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-24T15:15:28.618 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-24T15:15:28.618 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-24T15:15:28.618 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-24T15:15:28.618 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-01-24T15:15:28.618 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-24T15:15:28.618 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-24T15:15:28.618 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-24T15:15:28.618 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-24T15:15:28.618 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md 2024-01-24T15:15:28.618 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/bcache 2024-01-24T15:15:28.618 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/bcache/bcache.ko 2024-01-24T15:15:28.618 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-bio-prison.ko 2024-01-24T15:15:28.619 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-cache-smq.ko 2024-01-24T15:15:28.619 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-cache.ko 2024-01-24T15:15:28.619 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-crypt.ko 2024-01-24T15:15:28.619 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-delay.ko 2024-01-24T15:15:28.619 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-flakey.ko 2024-01-24T15:15:28.619 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-log-userspace.ko 2024-01-24T15:15:28.619 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-multipath.ko 2024-01-24T15:15:28.619 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-queue-length.ko 2024-01-24T15:15:28.619 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-raid.ko 2024-01-24T15:15:28.619 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-round-robin.ko 2024-01-24T15:15:28.619 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-service-time.ko 2024-01-24T15:15:28.619 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-switch.ko 2024-01-24T15:15:28.619 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-thin-pool.ko 2024-01-24T15:15:28.619 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-verity.ko 2024-01-24T15:15:28.619 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/faulty.ko 2024-01-24T15:15:28.620 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/linear.ko 2024-01-24T15:15:28.620 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/multipath.ko 2024-01-24T15:15:28.620 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/persistent-data 2024-01-24T15:15:28.620 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-24T15:15:28.620 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/raid0.ko 2024-01-24T15:15:28.620 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/raid1.ko 2024-01-24T15:15:28.620 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/raid10.ko 2024-01-24T15:15:28.620 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/raid456.ko 2024-01-24T15:15:28.620 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message 2024-01-24T15:15:28.620 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion 2024-01-24T15:15:28.620 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptbase.ko 2024-01-24T15:15:28.620 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptctl.ko 2024-01-24T15:15:28.620 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptfc.ko 2024-01-24T15:15:28.620 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptlan.ko 2024-01-24T15:15:28.620 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptsas.ko 2024-01-24T15:15:28.621 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptscsih.ko 2024-01-24T15:15:28.621 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptspi.ko 2024-01-24T15:15:28.621 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd 2024-01-24T15:15:28.621 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/lpc_ich.ko 2024-01-24T15:15:28.621 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/lpc_sch.ko 2024-01-24T15:15:28.621 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/mfd-core.ko 2024-01-24T15:15:28.621 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/sm501.ko 2024-01-24T15:15:28.621 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/viperboard.ko 2024-01-24T15:15:28.621 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/vx855.ko 2024-01-24T15:15:28.621 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/wl1273-core.ko 2024-01-24T15:15:28.621 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc 2024-01-24T15:15:28.621 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/altera-stapl 2024-01-24T15:15:28.621 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-24T15:15:28.621 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/apds9802als.ko 2024-01-24T15:15:28.621 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/apds990x.ko 2024-01-24T15:15:28.622 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/bh1770glc.ko 2024-01-24T15:15:28.622 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/cb710 2024-01-24T15:15:28.622 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/cb710/cb710.ko 2024-01-24T15:15:28.622 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/eeprom 2024-01-24T15:15:28.622 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/eeprom/at24.ko 2024-01-24T15:15:28.622 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-24T15:15:28.622 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/eeprom/max6875.ko 2024-01-24T15:15:28.622 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/enclosure.ko 2024-01-24T15:15:28.622 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/hpilo.ko 2024-01-24T15:15:28.622 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/isl29003.ko 2024-01-24T15:15:28.622 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/isl29020.ko 2024-01-24T15:15:28.622 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/lis3lv02d 2024-01-24T15:15:28.622 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-24T15:15:28.622 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-24T15:15:28.622 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/mei 2024-01-24T15:15:28.623 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/mei/mei-me.ko 2024-01-24T15:15:28.623 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/mei/mei-txe.ko 2024-01-24T15:15:28.623 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/mei/mei.ko 2024-01-24T15:15:28.623 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/sgi-gru 2024-01-24T15:15:28.623 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/sgi-gru/gru.ko 2024-01-24T15:15:28.623 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/sgi-xp 2024-01-24T15:15:28.623 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/sgi-xp/xp.ko 2024-01-24T15:15:28.623 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/sgi-xp/xpc.ko 2024-01-24T15:15:28.623 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-01-24T15:15:28.623 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/tifm_7xx1.ko 2024-01-24T15:15:28.623 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/tifm_core.ko 2024-01-24T15:15:28.623 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/tsl2550.ko 2024-01-24T15:15:28.623 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/vmw_balloon.ko 2024-01-24T15:15:28.623 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/vmw_vmci 2024-01-24T15:15:28.623 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-24T15:15:28.623 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net 2024-01-24T15:15:28.624 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/bonding 2024-01-24T15:15:28.624 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/bonding/bonding.ko 2024-01-24T15:15:28.624 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa 2024-01-24T15:15:28.624 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/b53 2024-01-24T15:15:28.624 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-24T15:15:28.624 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-24T15:15:28.624 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-24T15:15:28.624 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/mv88e6xxx 2024-01-24T15:15:28.624 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-24T15:15:28.624 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dummy.ko 2024-01-24T15:15:28.624 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/eql.ko 2024-01-24T15:15:28.624 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet 2024-01-24T15:15:28.624 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com 2024-01-24T15:15:28.624 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-24T15:15:28.624 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-24T15:15:28.625 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-24T15:15:28.625 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-24T15:15:28.625 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390 2024-01-24T15:15:28.625 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-24T15:15:28.625 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-24T15:15:28.625 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-24T15:15:28.625 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-24T15:15:28.625 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/adaptec 2024-01-24T15:15:28.625 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-24T15:15:28.625 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/agere 2024-01-24T15:15:28.625 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-24T15:15:28.625 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/alteon 2024-01-24T15:15:28.625 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-24T15:15:28.625 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/altera 2024-01-24T15:15:28.625 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-24T15:15:28.625 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/amd 2024-01-24T15:15:28.625 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-24T15:15:28.626 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-24T15:15:28.626 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-24T15:15:28.626 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros 2024-01-24T15:15:28.626 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/alx 2024-01-24T15:15:28.626 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-24T15:15:28.626 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atl1c 2024-01-24T15:15:28.626 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-24T15:15:28.626 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atl1e 2024-01-24T15:15:28.626 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-24T15:15:28.626 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atlx 2024-01-24T15:15:28.626 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-24T15:15:28.626 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-24T15:15:28.626 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom 2024-01-24T15:15:28.626 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-24T15:15:28.627 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-24T15:15:28.627 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-01-24T15:15:28.627 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-24T15:15:28.627 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-24T15:15:28.627 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/genet 2024-01-24T15:15:28.627 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-24T15:15:28.627 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-24T15:15:28.627 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/brocade 2024-01-24T15:15:28.627 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/brocade/bna 2024-01-24T15:15:28.627 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-24T15:15:28.627 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio 2024-01-24T15:15:28.627 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb 2024-01-24T15:15:28.627 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-24T15:15:28.627 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-01-24T15:15:28.627 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-24T15:15:28.627 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-01-24T15:15:28.628 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-24T15:15:28.628 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-01-24T15:15:28.628 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-24T15:15:28.628 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-01-24T15:15:28.628 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-24T15:15:28.628 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/cisco 2024-01-24T15:15:28.628 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/cisco/enic 2024-01-24T15:15:28.628 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-24T15:15:28.628 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec 2024-01-24T15:15:28.628 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip 2024-01-24T15:15:28.628 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-24T15:15:28.628 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-24T15:15:28.628 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-24T15:15:28.628 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-24T15:15:28.628 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-24T15:15:28.629 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-24T15:15:28.629 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dlink 2024-01-24T15:15:28.629 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-24T15:15:28.629 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-24T15:15:28.629 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dnet.ko 2024-01-24T15:15:28.629 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/emulex 2024-01-24T15:15:28.629 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/emulex/benet 2024-01-24T15:15:28.629 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-24T15:15:28.629 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/ethoc.ko 2024-01-24T15:15:28.629 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/fealnx.ko 2024-01-24T15:15:28.629 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel 2024-01-24T15:15:28.629 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-24T15:15:28.629 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e1000 2024-01-24T15:15:28.629 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-24T15:15:28.630 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e1000e 2024-01-24T15:15:28.630 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-24T15:15:28.630 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/fm10k 2024-01-24T15:15:28.630 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-24T15:15:28.630 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/i40e 2024-01-24T15:15:28.630 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-24T15:15:28.630 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/iavf 2024-01-24T15:15:28.630 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-24T15:15:28.630 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/igb 2024-01-24T15:15:28.630 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-24T15:15:28.630 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/igbvf 2024-01-24T15:15:28.630 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-24T15:15:28.630 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ixgbe 2024-01-24T15:15:28.630 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-24T15:15:28.630 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ixgbevf 2024-01-24T15:15:28.630 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-24T15:15:28.631 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/jme.ko 2024-01-24T15:15:28.631 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/marvell 2024-01-24T15:15:28.631 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-24T15:15:28.631 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-24T15:15:28.631 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-24T15:15:28.631 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox 2024-01-24T15:15:28.631 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx4 2024-01-24T15:15:28.631 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-24T15:15:28.631 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-24T15:15:28.631 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx5 2024-01-24T15:15:28.631 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-01-24T15:15:28.631 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-24T15:15:28.631 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/micrel 2024-01-24T15:15:28.631 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-24T15:15:28.632 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/myricom 2024-01-24T15:15:28.632 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/myricom/myri10ge 2024-01-24T15:15:28.632 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-24T15:15:28.632 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/natsemi 2024-01-24T15:15:28.632 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-24T15:15:28.632 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-24T15:15:28.632 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/neterion 2024-01-24T15:15:28.632 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-24T15:15:28.632 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/nvidia 2024-01-24T15:15:28.632 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-24T15:15:28.632 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/packetengines 2024-01-24T15:15:28.632 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-24T15:15:28.632 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-24T15:15:28.632 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic 2024-01-24T15:15:28.632 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/netxen 2024-01-24T15:15:28.633 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-24T15:15:28.633 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-24T15:15:28.633 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-01-24T15:15:28.633 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-24T15:15:28.633 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/rdc 2024-01-24T15:15:28.633 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-24T15:15:28.633 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek 2024-01-24T15:15:28.633 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-24T15:15:28.633 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-24T15:15:28.633 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-24T15:15:28.633 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-24T15:15:28.633 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/rocker 2024-01-24T15:15:28.633 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-01-24T15:15:28.633 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sfc 2024-01-24T15:15:28.633 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-24T15:15:28.633 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/silan 2024-01-24T15:15:28.634 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-24T15:15:28.634 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sis 2024-01-24T15:15:28.634 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-24T15:15:28.634 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-24T15:15:28.634 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc 2024-01-24T15:15:28.634 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-24T15:15:28.634 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-24T15:15:28.634 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-24T15:15:28.634 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-24T15:15:28.634 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro 2024-01-24T15:15:28.634 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/stmmac 2024-01-24T15:15:28.634 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-24T15:15:28.634 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-24T15:15:28.634 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun 2024-01-24T15:15:28.634 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-24T15:15:28.634 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-24T15:15:28.634 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-24T15:15:28.635 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-24T15:15:28.635 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/tehuti 2024-01-24T15:15:28.635 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-24T15:15:28.635 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/ti 2024-01-24T15:15:28.635 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-24T15:15:28.635 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/via 2024-01-24T15:15:28.635 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-24T15:15:28.635 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-24T15:15:28.635 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/wiznet 2024-01-24T15:15:28.635 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-24T15:15:28.635 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-24T15:15:28.635 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/xircom 2024-01-24T15:15:28.635 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-24T15:15:28.635 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/geneve.ko 2024-01-24T15:15:28.635 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/hyperv 2024-01-24T15:15:28.636 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-24T15:15:28.636 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ieee802154 2024-01-24T15:15:28.636 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-24T15:15:28.636 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ifb.ko 2024-01-24T15:15:28.636 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ipvlan 2024-01-24T15:15:28.636 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-24T15:15:28.636 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/macvlan.ko 2024-01-24T15:15:28.636 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/macvtap.ko 2024-01-24T15:15:28.636 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio 2024-01-24T15:15:28.636 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio.ko 2024-01-24T15:15:28.636 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-24T15:15:28.636 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-24T15:15:28.636 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-24T15:15:28.636 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mii.ko 2024-01-24T15:15:28.636 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/net_failover.ko 2024-01-24T15:15:28.637 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/netconsole.ko 2024-01-24T15:15:28.637 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/nlmon.ko 2024-01-24T15:15:28.637 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/pcs 2024-01-24T15:15:28.637 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-24T15:15:28.637 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-24T15:15:28.637 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy 2024-01-24T15:15:28.637 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/amd.ko 2024-01-24T15:15:28.637 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-24T15:15:28.637 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-01-24T15:15:28.637 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-24T15:15:28.637 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/bcm87xx.ko 2024-01-24T15:15:28.637 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/broadcom.ko 2024-01-24T15:15:28.637 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/cicada.ko 2024-01-24T15:15:28.637 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/davicom.ko 2024-01-24T15:15:28.638 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/dp83640.ko 2024-01-24T15:15:28.638 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/et1011c.ko 2024-01-24T15:15:28.638 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/icplus.ko 2024-01-24T15:15:28.638 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/lxt.ko 2024-01-24T15:15:28.638 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/marvell.ko 2024-01-24T15:15:28.638 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/micrel.ko 2024-01-24T15:15:28.638 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/national.ko 2024-01-24T15:15:28.638 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/phylink.ko 2024-01-24T15:15:28.638 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/qsemi.ko 2024-01-24T15:15:28.638 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/realtek.ko 2024-01-24T15:15:28.638 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/smsc.ko 2024-01-24T15:15:28.638 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/ste10Xp.ko 2024-01-24T15:15:28.638 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/vitesse.ko 2024-01-24T15:15:28.638 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp 2024-01-24T15:15:28.639 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-24T15:15:28.639 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_async.ko 2024-01-24T15:15:28.639 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-24T15:15:28.639 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_generic.ko 2024-01-24T15:15:28.639 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-24T15:15:28.639 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-24T15:15:28.639 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/pppoe.ko 2024-01-24T15:15:28.639 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/pppox.ko 2024-01-24T15:15:28.639 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/pptp.ko 2024-01-24T15:15:28.639 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/slip 2024-01-24T15:15:28.639 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/slip/slhc.ko 2024-01-24T15:15:28.639 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/slip/slip.ko 2024-01-24T15:15:28.639 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/sungem_phy.ko 2024-01-24T15:15:28.639 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/tap.ko 2024-01-24T15:15:28.640 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team 2024-01-24T15:15:28.640 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team.ko 2024-01-24T15:15:28.640 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-24T15:15:28.640 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-24T15:15:28.640 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-24T15:15:28.640 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_random.ko 2024-01-24T15:15:28.640 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-24T15:15:28.640 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/tun.ko 2024-01-24T15:15:28.640 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/veth.ko 2024-01-24T15:15:28.640 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/virtio_net.ko 2024-01-24T15:15:28.640 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/vmxnet3 2024-01-24T15:15:28.640 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-24T15:15:28.640 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/vxlan 2024-01-24T15:15:28.640 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/vxlan/vxlan.ko 2024-01-24T15:15:28.641 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/xen-netback 2024-01-24T15:15:28.641 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-24T15:15:28.641 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/xen-netfront.ko 2024-01-24T15:15:28.641 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ntb 2024-01-24T15:15:28.641 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ntb/ntb.ko 2024-01-24T15:15:28.641 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/nvme 2024-01-24T15:15:28.641 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/nvme/host 2024-01-24T15:15:28.641 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/nvme/host/nvme-core.ko 2024-01-24T15:15:28.641 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/nvme/host/nvme.ko 2024-01-24T15:15:28.641 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport 2024-01-24T15:15:28.641 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/parport.ko 2024-01-24T15:15:28.641 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/parport_cs.ko 2024-01-24T15:15:28.641 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/parport_pc.ko 2024-01-24T15:15:28.641 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/parport_serial.ko 2024-01-24T15:15:28.642 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci 2024-01-24T15:15:28.642 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/hotplug 2024-01-24T15:15:28.642 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-24T15:15:28.642 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/pcie 2024-01-24T15:15:28.642 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/pcie/aer_inject.ko 2024-01-24T15:15:28.642 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/xen-pcifront.ko 2024-01-24T15:15:28.642 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia 2024-01-24T15:15:28.642 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/i82092.ko 2024-01-24T15:15:28.642 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/pd6729.ko 2024-01-24T15:15:28.642 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-24T15:15:28.642 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pinctrl 2024-01-24T15:15:28.642 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pinctrl/intel 2024-01-24T15:15:28.642 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-24T15:15:28.642 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform 2024-01-24T15:15:28.643 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86 2024-01-24T15:15:28.643 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-24T15:15:28.643 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/acerhdf.ko 2024-01-24T15:15:28.643 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-24T15:15:28.643 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-24T15:15:28.643 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-24T15:15:28.643 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-24T15:15:28.643 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-24T15:15:28.643 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-24T15:15:28.643 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-24T15:15:28.643 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-24T15:15:28.643 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-24T15:15:28.643 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/hdaps.ko 2024-01-24T15:15:28.643 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/intel 2024-01-24T15:15:28.644 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-24T15:15:28.644 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/intel_ips.ko 2024-01-24T15:15:28.644 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-24T15:15:28.644 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-24T15:15:28.644 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-24T15:15:28.644 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-24T15:15:28.644 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-24T15:15:28.644 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-24T15:15:28.644 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-24T15:15:28.644 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-24T15:15:28.644 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-24T15:15:28.644 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/wmi.ko 2024-01-24T15:15:28.644 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/powercap 2024-01-24T15:15:28.644 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-24T15:15:28.644 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-24T15:15:28.645 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps 2024-01-24T15:15:28.645 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/clients 2024-01-24T15:15:28.645 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-24T15:15:28.645 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-24T15:15:28.645 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/clients/pps_parport.ko 2024-01-24T15:15:28.645 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/pps_core.ko 2024-01-24T15:15:28.645 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ptp 2024-01-24T15:15:28.645 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ptp/ptp.ko 2024-01-24T15:15:28.645 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ptp/ptp_kvm.ko 2024-01-24T15:15:28.645 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc 2024-01-24T15:15:28.645 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-24T15:15:28.645 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-24T15:15:28.645 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-24T15:15:28.645 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-24T15:15:28.646 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-24T15:15:28.646 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-24T15:15:28.646 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-24T15:15:28.646 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-24T15:15:28.646 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-24T15:15:28.646 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-24T15:15:28.646 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-em3027.ko 2024-01-24T15:15:28.646 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-24T15:15:28.646 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-24T15:15:28.646 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-24T15:15:28.646 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-24T15:15:28.646 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-24T15:15:28.646 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-24T15:15:28.646 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-max6900.ko 2024-01-24T15:15:28.647 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-24T15:15:28.647 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-24T15:15:28.647 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-24T15:15:28.647 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-24T15:15:28.647 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-24T15:15:28.647 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-24T15:15:28.647 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-24T15:15:28.647 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-24T15:15:28.647 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-24T15:15:28.647 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-24T15:15:28.647 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-24T15:15:28.647 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-24T15:15:28.647 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-x1205.ko 2024-01-24T15:15:28.647 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi 2024-01-24T15:15:28.647 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/3w-9xxx.ko 2024-01-24T15:15:28.648 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/3w-sas.ko 2024-01-24T15:15:28.648 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/3w-xxxx.ko 2024-01-24T15:15:28.648 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/BusLogic.ko 2024-01-24T15:15:28.648 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/a100u2w.ko 2024-01-24T15:15:28.648 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aacraid 2024-01-24T15:15:28.648 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-24T15:15:28.648 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/advansys.ko 2024-01-24T15:15:28.648 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aic7xxx 2024-01-24T15:15:28.648 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-24T15:15:28.648 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-24T15:15:28.648 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/am53c974.ko 2024-01-24T15:15:28.648 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/arcmsr 2024-01-24T15:15:28.648 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-24T15:15:28.649 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/atp870u.ko 2024-01-24T15:15:28.649 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/be2iscsi 2024-01-24T15:15:28.649 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-24T15:15:28.649 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bfa 2024-01-24T15:15:28.649 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bfa/bfa.ko 2024-01-24T15:15:28.649 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bnx2fc 2024-01-24T15:15:28.649 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-24T15:15:28.649 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bnx2i 2024-01-24T15:15:28.649 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-24T15:15:28.649 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ch.ko 2024-01-24T15:15:28.649 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/csiostor 2024-01-24T15:15:28.649 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-24T15:15:28.649 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi 2024-01-24T15:15:28.649 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/cxgb3i 2024-01-24T15:15:28.649 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-24T15:15:28.650 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/cxgb4i 2024-01-24T15:15:28.650 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-24T15:15:28.650 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-24T15:15:28.650 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/dc395x.ko 2024-01-24T15:15:28.650 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/device_handler 2024-01-24T15:15:28.650 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-01-24T15:15:28.650 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-01-24T15:15:28.650 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-01-24T15:15:28.650 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-01-24T15:15:28.650 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/dmx3191d.ko 2024-01-24T15:15:28.650 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/esas2r 2024-01-24T15:15:28.650 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-24T15:15:28.650 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/esp_scsi.ko 2024-01-24T15:15:28.650 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fcoe 2024-01-24T15:15:28.651 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-24T15:15:28.651 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-24T15:15:28.651 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fnic 2024-01-24T15:15:28.651 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fnic/fnic.ko 2024-01-24T15:15:28.651 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/hpsa.ko 2024-01-24T15:15:28.651 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/hptiop.ko 2024-01-24T15:15:28.651 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/hv_storvsc.ko 2024-01-24T15:15:28.651 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/initio.ko 2024-01-24T15:15:28.651 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ipr.ko 2024-01-24T15:15:28.651 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ips.ko 2024-01-24T15:15:28.651 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/isci 2024-01-24T15:15:28.651 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/isci/isci.ko 2024-01-24T15:15:28.651 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-24T15:15:28.651 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-24T15:15:28.651 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libfc 2024-01-24T15:15:28.652 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libfc/libfc.ko 2024-01-24T15:15:28.652 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libiscsi.ko 2024-01-24T15:15:28.652 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-24T15:15:28.652 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libsas 2024-01-24T15:15:28.652 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libsas/libsas.ko 2024-01-24T15:15:28.652 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/lpfc 2024-01-24T15:15:28.652 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-24T15:15:28.652 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid 2024-01-24T15:15:28.652 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid.ko 2024-01-24T15:15:28.652 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-24T15:15:28.652 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-24T15:15:28.652 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-24T15:15:28.652 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mpt3sas 2024-01-24T15:15:28.652 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-24T15:15:28.652 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mvsas 2024-01-24T15:15:28.653 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-24T15:15:28.653 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mvumi.ko 2024-01-24T15:15:28.653 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pm8001 2024-01-24T15:15:28.653 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-24T15:15:28.653 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pmcraid.ko 2024-01-24T15:15:28.653 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla1280.ko 2024-01-24T15:15:28.653 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla2xxx 2024-01-24T15:15:28.653 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-24T15:15:28.653 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-24T15:15:28.653 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla4xxx 2024-01-24T15:15:28.653 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-24T15:15:28.653 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/raid_class.ko 2024-01-24T15:15:28.653 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_debug.ko 2024-01-24T15:15:28.653 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-24T15:15:28.653 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-24T15:15:28.654 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-24T15:15:28.654 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-24T15:15:28.654 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-24T15:15:28.654 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ses.ko 2024-01-24T15:15:28.654 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/st.ko 2024-01-24T15:15:28.654 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/stex.ko 2024-01-24T15:15:28.654 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/sym53c8xx_2 2024-01-24T15:15:28.654 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-24T15:15:28.654 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/virtio_scsi.ko 2024-01-24T15:15:28.654 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-24T15:15:28.654 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/wd719x.ko 2024-01-24T15:15:28.654 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ssb 2024-01-24T15:15:28.654 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ssb/ssb.ko 2024-01-24T15:15:28.654 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target 2024-01-24T15:15:28.655 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/iscsi 2024-01-24T15:15:28.655 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-24T15:15:28.655 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/loopback 2024-01-24T15:15:28.655 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-24T15:15:28.655 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_file.ko 2024-01-24T15:15:28.655 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_iblock.ko 2024-01-24T15:15:28.655 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_mod.ko 2024-01-24T15:15:28.655 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_pscsi.ko 2024-01-24T15:15:28.655 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_user.ko 2024-01-24T15:15:28.655 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/tcm_fc 2024-01-24T15:15:28.655 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-24T15:15:28.655 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal 2024-01-24T15:15:28.655 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel 2024-01-24T15:15:28.655 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal 2024-01-24T15:15:28.655 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-24T15:15:28.655 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-24T15:15:28.656 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-24T15:15:28.656 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-24T15:15:28.656 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-24T15:15:28.656 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-24T15:15:28.656 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-24T15:15:28.656 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-24T15:15:28.656 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-24T15:15:28.656 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-24T15:15:28.656 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-01-24T15:15:28.656 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-24T15:15:28.656 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-24T15:15:28.656 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-01-24T15:15:28.656 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-01-24T15:15:28.657 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-24T15:15:28.657 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-24T15:15:28.657 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-24T15:15:28.657 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty 2024-01-24T15:15:28.657 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/ipwireless 2024-01-24T15:15:28.657 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-24T15:15:28.657 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/n_gsm.ko 2024-01-24T15:15:28.657 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/n_hdlc.ko 2024-01-24T15:15:28.657 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/nozomi.ko 2024-01-24T15:15:28.657 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial 2024-01-24T15:15:28.657 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/8250 2024-01-24T15:15:28.657 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-24T15:15:28.657 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/arc_uart.ko 2024-01-24T15:15:28.657 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/jsm 2024-01-24T15:15:28.657 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-24T15:15:28.658 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs 2024-01-24T15:15:28.658 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/core 2024-01-24T15:15:28.658 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-24T15:15:28.658 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/host 2024-01-24T15:15:28.658 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-24T15:15:28.658 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio 2024-01-24T15:15:28.658 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio.ko 2024-01-24T15:15:28.658 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_aec.ko 2024-01-24T15:15:28.658 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_cif.ko 2024-01-24T15:15:28.658 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_pci_generic.ko 2024-01-24T15:15:28.658 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_sercos3.ko 2024-01-24T15:15:28.658 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb 2024-01-24T15:15:28.658 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class 2024-01-24T15:15:28.658 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/cdc-acm.ko 2024-01-24T15:15:28.658 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-24T15:15:28.659 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/usblp.ko 2024-01-24T15:15:28.659 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/usbtmc.ko 2024-01-24T15:15:28.659 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host 2024-01-24T15:15:28.659 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-24T15:15:28.659 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/image 2024-01-24T15:15:28.659 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/image/mdc800.ko 2024-01-24T15:15:28.659 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/image/microtek.ko 2024-01-24T15:15:28.659 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc 2024-01-24T15:15:28.659 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/adutux.ko 2024-01-24T15:15:28.659 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/appledisplay.ko 2024-01-24T15:15:28.659 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/emi26.ko 2024-01-24T15:15:28.659 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/emi62.ko 2024-01-24T15:15:28.659 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/ezusb.ko 2024-01-24T15:15:28.659 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/idmouse.ko 2024-01-24T15:15:28.659 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/iowarrior.ko 2024-01-24T15:15:28.660 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-24T15:15:28.660 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/ldusb.ko 2024-01-24T15:15:28.660 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/legousbtower.ko 2024-01-24T15:15:28.660 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/sisusbvga 2024-01-24T15:15:28.660 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-24T15:15:28.660 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-24T15:15:28.660 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/usb3503.ko 2024-01-24T15:15:28.660 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/usblcd.ko 2024-01-24T15:15:28.660 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-24T15:15:28.660 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/uss720.ko 2024-01-24T15:15:28.660 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/yurex.ko 2024-01-24T15:15:28.660 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/phy 2024-01-24T15:15:28.660 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/phy/phy-generic.ko 2024-01-24T15:15:28.660 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial 2024-01-24T15:15:28.661 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/aircable.ko 2024-01-24T15:15:28.661 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ark3116.ko 2024-01-24T15:15:28.661 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-24T15:15:28.661 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ch341.ko 2024-01-24T15:15:28.661 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/cp210x.ko 2024-01-24T15:15:28.661 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/cyberjack.ko 2024-01-24T15:15:28.661 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-24T15:15:28.661 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-24T15:15:28.661 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/empeg.ko 2024-01-24T15:15:28.661 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-24T15:15:28.661 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-24T15:15:28.661 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-24T15:15:28.661 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/io_ti.ko 2024-01-24T15:15:28.661 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ipaq.ko 2024-01-24T15:15:28.661 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ipw.ko 2024-01-24T15:15:28.662 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ir-usb.ko 2024-01-24T15:15:28.662 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-24T15:15:28.662 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/keyspan.ko 2024-01-24T15:15:28.662 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-24T15:15:28.662 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-24T15:15:28.662 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-24T15:15:28.662 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/mct_u232.ko 2024-01-24T15:15:28.662 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/mos7720.ko 2024-01-24T15:15:28.662 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/mos7840.ko 2024-01-24T15:15:28.662 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/navman.ko 2024-01-24T15:15:28.662 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/omninet.ko 2024-01-24T15:15:28.662 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/opticon.ko 2024-01-24T15:15:28.662 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/option.ko 2024-01-24T15:15:28.662 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/oti6858.ko 2024-01-24T15:15:28.662 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/pl2303.ko 2024-01-24T15:15:28.663 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/qcaux.ko 2024-01-24T15:15:28.663 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/qcserial.ko 2024-01-24T15:15:28.663 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/quatech2.ko 2024-01-24T15:15:28.663 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/safe_serial.ko 2024-01-24T15:15:28.663 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/sierra.ko 2024-01-24T15:15:28.663 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-24T15:15:28.663 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ssu100.ko 2024-01-24T15:15:28.663 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/symbolserial.ko 2024-01-24T15:15:28.663 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-24T15:15:28.663 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-24T15:15:28.663 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/usb_debug.ko 2024-01-24T15:15:28.663 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-24T15:15:28.663 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/visor.ko 2024-01-24T15:15:28.663 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/whiteheat.ko 2024-01-24T15:15:28.663 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-24T15:15:28.664 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage 2024-01-24T15:15:28.664 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/uas.ko 2024-01-24T15:15:28.664 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-24T15:15:28.664 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-24T15:15:28.664 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-24T15:15:28.664 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-24T15:15:28.664 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-24T15:15:28.664 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-24T15:15:28.664 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-24T15:15:28.664 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-karma.ko 2024-01-24T15:15:28.664 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-24T15:15:28.664 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-24T15:15:28.664 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-24T15:15:28.664 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-24T15:15:28.665 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-24T15:15:28.665 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/usb-storage.ko 2024-01-24T15:15:28.665 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/usbip 2024-01-24T15:15:28.665 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-24T15:15:28.665 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-24T15:15:28.665 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-24T15:15:28.665 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio 2024-01-24T15:15:28.665 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/pci 2024-01-24T15:15:28.665 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-24T15:15:28.665 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-24T15:15:28.665 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/vfio.ko 2024-01-24T15:15:28.665 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-24T15:15:28.665 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost 2024-01-24T15:15:28.665 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/vhost.ko 2024-01-24T15:15:28.665 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-24T15:15:28.666 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/vhost_net.ko 2024-01-24T15:15:28.666 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/vhost_scsi.ko 2024-01-24T15:15:28.666 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/video 2024-01-24T15:15:28.666 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight 2024-01-24T15:15:28.666 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/apple_bl.ko 2024-01-24T15:15:28.666 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/lcd.ko 2024-01-24T15:15:28.666 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-24T15:15:28.666 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/virtio 2024-01-24T15:15:28.666 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/virtio/virtio.ko 2024-01-24T15:15:28.666 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/virtio/virtio_balloon.ko 2024-01-24T15:15:28.666 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/virtio/virtio_mmio.ko 2024-01-24T15:15:28.666 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/virtio/virtio_pci.ko 2024-01-24T15:15:28.666 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-01-24T15:15:28.666 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-01-24T15:15:28.666 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/virtio/virtio_ring.ko 2024-01-24T15:15:28.666 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1 2024-01-24T15:15:28.667 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/masters 2024-01-24T15:15:28.667 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/masters/ds2482.ko 2024-01-24T15:15:28.667 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/masters/ds2490.ko 2024-01-24T15:15:28.667 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves 2024-01-24T15:15:28.667 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-24T15:15:28.667 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-24T15:15:28.667 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-24T15:15:28.667 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-24T15:15:28.667 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-24T15:15:28.667 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-24T15:15:28.667 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-24T15:15:28.667 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-24T15:15:28.667 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-24T15:15:28.667 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-24T15:15:28.667 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-24T15:15:28.668 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/wire.ko 2024-01-24T15:15:28.668 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog 2024-01-24T15:15:28.668 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-24T15:15:28.668 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-24T15:15:28.668 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-24T15:15:28.668 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/hpwdt.ko 2024-01-24T15:15:28.668 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/i6300esb.ko 2024-01-24T15:15:28.668 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-24T15:15:28.668 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-24T15:15:28.668 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/ib700wdt.ko 2024-01-24T15:15:28.668 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/ibmasr.ko 2024-01-24T15:15:28.668 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-24T15:15:28.668 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-24T15:15:28.668 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/it87_wdt.ko 2024-01-24T15:15:28.669 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/machzwd.ko 2024-01-24T15:15:28.669 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/nv_tco.ko 2024-01-24T15:15:28.669 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-24T15:15:28.669 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-24T15:15:28.669 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-24T15:15:28.669 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-24T15:15:28.669 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/softdog.ko 2024-01-24T15:15:28.669 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-24T15:15:28.669 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/via_wdt.ko 2024-01-24T15:15:28.669 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-24T15:15:28.669 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-24T15:15:28.669 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-24T15:15:28.669 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/wdt_pci.ko 2024-01-24T15:15:28.669 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/xen_wdt.ko 2024-01-24T15:15:28.670 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen 2024-01-24T15:15:28.670 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-acpi-processor.ko 2024-01-24T15:15:28.670 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-evtchn.ko 2024-01-24T15:15:28.670 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-gntalloc.ko 2024-01-24T15:15:28.670 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-gntdev.ko 2024-01-24T15:15:28.670 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-pciback 2024-01-24T15:15:28.670 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-24T15:15:28.670 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-privcmd.ko 2024-01-24T15:15:28.670 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xenfs 2024-01-24T15:15:28.670 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-24T15:15:28.670 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs 2024-01-24T15:15:28.670 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/9p 2024-01-24T15:15:28.670 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/9p/9p.ko 2024-01-24T15:15:28.671 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/affs 2024-01-24T15:15:28.671 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/affs/affs.ko 2024-01-24T15:15:28.671 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/befs 2024-01-24T15:15:28.671 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/befs/befs.ko 2024-01-24T15:15:28.671 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/binfmt_misc.ko 2024-01-24T15:15:28.671 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/btrfs 2024-01-24T15:15:28.671 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/btrfs/btrfs.ko 2024-01-24T15:15:28.671 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/cachefiles 2024-01-24T15:15:28.671 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/cachefiles/cachefiles.ko 2024-01-24T15:15:28.671 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ceph 2024-01-24T15:15:28.671 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ceph/ceph.ko 2024-01-24T15:15:28.671 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/coda 2024-01-24T15:15:28.671 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/coda/coda.ko 2024-01-24T15:15:28.671 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/cramfs 2024-01-24T15:15:28.671 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/cramfs/cramfs.ko 2024-01-24T15:15:28.672 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/dlm 2024-01-24T15:15:28.672 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/dlm/dlm.ko 2024-01-24T15:15:28.672 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ecryptfs 2024-01-24T15:15:28.672 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ecryptfs/ecryptfs.ko 2024-01-24T15:15:28.672 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/f2fs 2024-01-24T15:15:28.672 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/f2fs/f2fs.ko 2024-01-24T15:15:28.672 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fat 2024-01-24T15:15:28.672 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fat/fat.ko 2024-01-24T15:15:28.672 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fat/msdos.ko 2024-01-24T15:15:28.672 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fat/vfat.ko 2024-01-24T15:15:28.672 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fscache 2024-01-24T15:15:28.672 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fscache/fscache.ko 2024-01-24T15:15:28.672 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fuse 2024-01-24T15:15:28.672 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fuse/cuse.ko 2024-01-24T15:15:28.672 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fuse/fuse.ko 2024-01-24T15:15:28.673 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/gfs2 2024-01-24T15:15:28.673 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/gfs2/gfs2.ko 2024-01-24T15:15:28.673 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/hfs 2024-01-24T15:15:28.673 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/hfs/hfs.ko 2024-01-24T15:15:28.673 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/hfsplus 2024-01-24T15:15:28.673 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/hfsplus/hfsplus.ko 2024-01-24T15:15:28.673 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/isofs 2024-01-24T15:15:28.673 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/isofs/isofs.ko 2024-01-24T15:15:28.673 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/jfs 2024-01-24T15:15:28.673 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/jfs/jfs.ko 2024-01-24T15:15:28.673 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/lockd 2024-01-24T15:15:28.673 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/lockd/lockd.ko 2024-01-24T15:15:28.673 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/minix 2024-01-24T15:15:28.673 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/minix/minix.ko 2024-01-24T15:15:28.674 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/netfs 2024-01-24T15:15:28.674 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/netfs/netfs.ko 2024-01-24T15:15:28.674 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs 2024-01-24T15:15:28.674 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/blocklayout 2024-01-24T15:15:28.674 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-24T15:15:28.674 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/filelayout 2024-01-24T15:15:28.674 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-24T15:15:28.674 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/flexfilelayout 2024-01-24T15:15:28.674 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-24T15:15:28.674 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/nfs.ko 2024-01-24T15:15:28.674 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/nfsv3.ko 2024-01-24T15:15:28.674 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/nfsv4.ko 2024-01-24T15:15:28.674 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs_common 2024-01-24T15:15:28.674 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs_common/grace.ko 2024-01-24T15:15:28.674 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs_common/nfs_acl.ko 2024-01-24T15:15:28.675 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfsd 2024-01-24T15:15:28.675 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfsd/nfsd.ko 2024-01-24T15:15:28.675 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nilfs2 2024-01-24T15:15:28.675 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nilfs2/nilfs2.ko 2024-01-24T15:15:28.675 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls 2024-01-24T15:15:28.675 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-celtic.ko 2024-01-24T15:15:28.675 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-centeuro.ko 2024-01-24T15:15:28.675 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-croatian.ko 2024-01-24T15:15:28.675 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-cyrillic.ko 2024-01-24T15:15:28.675 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-gaelic.ko 2024-01-24T15:15:28.675 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-greek.ko 2024-01-24T15:15:28.675 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-iceland.ko 2024-01-24T15:15:28.675 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-inuit.ko 2024-01-24T15:15:28.675 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-roman.ko 2024-01-24T15:15:28.675 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-romanian.ko 2024-01-24T15:15:28.676 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-turkish.ko 2024-01-24T15:15:28.676 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp1250.ko 2024-01-24T15:15:28.676 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp1251.ko 2024-01-24T15:15:28.676 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp1255.ko 2024-01-24T15:15:28.676 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp737.ko 2024-01-24T15:15:28.676 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp775.ko 2024-01-24T15:15:28.676 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp850.ko 2024-01-24T15:15:28.676 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp852.ko 2024-01-24T15:15:28.676 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp855.ko 2024-01-24T15:15:28.676 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp857.ko 2024-01-24T15:15:28.676 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp860.ko 2024-01-24T15:15:28.676 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp861.ko 2024-01-24T15:15:28.676 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp862.ko 2024-01-24T15:15:28.676 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp863.ko 2024-01-24T15:15:28.677 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp864.ko 2024-01-24T15:15:28.677 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp865.ko 2024-01-24T15:15:28.677 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp866.ko 2024-01-24T15:15:28.677 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp869.ko 2024-01-24T15:15:28.677 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp874.ko 2024-01-24T15:15:28.677 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp932.ko 2024-01-24T15:15:28.677 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp936.ko 2024-01-24T15:15:28.677 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp949.ko 2024-01-24T15:15:28.677 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp950.ko 2024-01-24T15:15:28.677 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_euc-jp.ko 2024-01-24T15:15:28.677 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-1.ko 2024-01-24T15:15:28.677 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-13.ko 2024-01-24T15:15:28.677 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-14.ko 2024-01-24T15:15:28.677 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-15.ko 2024-01-24T15:15:28.677 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-2.ko 2024-01-24T15:15:28.678 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-3.ko 2024-01-24T15:15:28.678 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-4.ko 2024-01-24T15:15:28.678 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-5.ko 2024-01-24T15:15:28.678 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-6.ko 2024-01-24T15:15:28.678 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-7.ko 2024-01-24T15:15:28.678 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-9.ko 2024-01-24T15:15:28.678 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_koi8-r.ko 2024-01-24T15:15:28.678 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_koi8-ru.ko 2024-01-24T15:15:28.678 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_koi8-u.ko 2024-01-24T15:15:28.678 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-24T15:15:28.678 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_utf8.ko 2024-01-24T15:15:28.678 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2 2024-01-24T15:15:28.678 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/cluster 2024-01-24T15:15:28.678 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-24T15:15:28.678 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/dlm 2024-01-24T15:15:28.679 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-24T15:15:28.679 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/dlmfs 2024-01-24T15:15:28.679 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-24T15:15:28.679 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ocfs2.ko 2024-01-24T15:15:28.679 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-24T15:15:28.679 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-24T15:15:28.679 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-24T15:15:28.679 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/overlayfs 2024-01-24T15:15:28.679 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/overlayfs/overlay.ko 2024-01-24T15:15:28.679 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/pstore 2024-01-24T15:15:28.679 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/pstore/ramoops.ko 2024-01-24T15:15:28.679 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/reiserfs 2024-01-24T15:15:28.679 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/reiserfs/reiserfs.ko 2024-01-24T15:15:28.679 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/romfs 2024-01-24T15:15:28.680 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/romfs/romfs.ko 2024-01-24T15:15:28.680 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/smb 2024-01-24T15:15:28.680 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/client 2024-01-24T15:15:28.680 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/client/cifs.ko 2024-01-24T15:15:28.680 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/common 2024-01-24T15:15:28.680 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/common/cifs_arc4.ko 2024-01-24T15:15:28.680 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/common/cifs_md4.ko 2024-01-24T15:15:28.680 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/squashfs 2024-01-24T15:15:28.680 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/squashfs/squashfs.ko 2024-01-24T15:15:28.680 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/sysv 2024-01-24T15:15:28.680 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/sysv/sysv.ko 2024-01-24T15:15:28.680 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/udf 2024-01-24T15:15:28.680 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/udf/udf.ko 2024-01-24T15:15:28.680 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ufs 2024-01-24T15:15:28.681 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ufs/ufs.ko 2024-01-24T15:15:28.681 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/xfs 2024-01-24T15:15:28.681 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/xfs/xfs.ko 2024-01-24T15:15:28.681 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/kernel 2024-01-24T15:15:28.681 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/kernel/rcu 2024-01-24T15:15:28.681 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/kernel/rcu/rcutorture.ko 2024-01-24T15:15:28.681 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/kernel/torture.ko 2024-01-24T15:15:28.681 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/kernel/trace 2024-01-24T15:15:28.681 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-01-24T15:15:28.681 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib 2024-01-24T15:15:28.681 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/asn1_encoder.ko 2024-01-24T15:15:28.681 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/crc-itu-t.ko 2024-01-24T15:15:28.681 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/crc8.ko 2024-01-24T15:15:28.681 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/crypto 2024-01-24T15:15:28.681 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/crypto/libarc4.ko 2024-01-24T15:15:28.682 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/crypto/libdes.ko 2024-01-24T15:15:28.682 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/libcrc32c.ko 2024-01-24T15:15:28.682 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/lru_cache.ko 2024-01-24T15:15:28.682 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/lz4 2024-01-24T15:15:28.682 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/lz4/lz4_compress.ko 2024-01-24T15:15:28.682 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/lz4/lz4hc_compress.ko 2024-01-24T15:15:28.682 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/math 2024-01-24T15:15:28.682 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/math/cordic.ko 2024-01-24T15:15:28.682 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/raid6 2024-01-24T15:15:28.682 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/raid6/raid6_pq.ko 2024-01-24T15:15:28.682 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/reed_solomon 2024-01-24T15:15:28.682 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-24T15:15:28.682 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/ts_bm.ko 2024-01-24T15:15:28.682 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/ts_fsm.ko 2024-01-24T15:15:28.682 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/ts_kmp.ko 2024-01-24T15:15:28.683 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/zstd 2024-01-24T15:15:28.683 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/zstd/zstd_compress.ko 2024-01-24T15:15:28.683 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/mm 2024-01-24T15:15:28.683 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/mm/hwpoison-inject.ko 2024-01-24T15:15:28.683 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net 2024-01-24T15:15:28.683 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan 2024-01-24T15:15:28.683 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/6lowpan.ko 2024-01-24T15:15:28.683 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_dest.ko 2024-01-24T15:15:28.683 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_fragment.ko 2024-01-24T15:15:28.683 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_hop.ko 2024-01-24T15:15:28.683 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-24T15:15:28.683 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_mobility.ko 2024-01-24T15:15:28.683 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_routing.ko 2024-01-24T15:15:28.683 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_udp.ko 2024-01-24T15:15:28.683 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/802 2024-01-24T15:15:28.684 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/802/garp.ko 2024-01-24T15:15:28.684 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/802/mrp.ko 2024-01-24T15:15:28.684 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/802/p8022.ko 2024-01-24T15:15:28.684 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/802/psnap.ko 2024-01-24T15:15:28.684 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/802/stp.ko 2024-01-24T15:15:28.684 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/8021q 2024-01-24T15:15:28.684 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/8021q/8021q.ko 2024-01-24T15:15:28.684 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/9p 2024-01-24T15:15:28.684 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/9p/9pnet.ko 2024-01-24T15:15:28.684 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/9p/9pnet_fd.ko 2024-01-24T15:15:28.684 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/9p/9pnet_rdma.ko 2024-01-24T15:15:28.684 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/9p/9pnet_virtio.ko 2024-01-24T15:15:28.684 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/batman-adv 2024-01-24T15:15:28.684 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/batman-adv/batman-adv.ko 2024-01-24T15:15:28.685 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge 2024-01-24T15:15:28.685 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/br_netfilter.ko 2024-01-24T15:15:28.685 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/bridge.ko 2024-01-24T15:15:28.685 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter 2024-01-24T15:15:28.685 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-24T15:15:28.685 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-24T15:15:28.685 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-24T15:15:28.685 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-24T15:15:28.685 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-24T15:15:28.685 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-24T15:15:28.685 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-24T15:15:28.685 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-24T15:15:28.685 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-24T15:15:28.685 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-24T15:15:28.685 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-24T15:15:28.685 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-24T15:15:28.686 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-24T15:15:28.686 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-24T15:15:28.686 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-24T15:15:28.686 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-24T15:15:28.686 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-24T15:15:28.686 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-24T15:15:28.686 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-24T15:15:28.686 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-24T15:15:28.686 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebtables.ko 2024-01-24T15:15:28.686 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-01-24T15:15:28.686 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-24T15:15:28.686 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-24T15:15:28.686 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ceph 2024-01-24T15:15:28.686 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ceph/libceph.ko 2024-01-24T15:15:28.687 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/core 2024-01-24T15:15:28.687 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/core/failover.ko 2024-01-24T15:15:28.687 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/core/pktgen.ko 2024-01-24T15:15:28.687 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dccp 2024-01-24T15:15:28.687 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/dccp.ko 2024-01-24T15:15:28.687 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/dccp_diag.ko 2024-01-24T15:15:28.687 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/dccp_ipv4.ko 2024-01-24T15:15:28.687 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/dccp_ipv6.ko 2024-01-24T15:15:28.687 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dns_resolver 2024-01-24T15:15:28.687 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dns_resolver/dns_resolver.ko 2024-01-24T15:15:28.687 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dsa 2024-01-24T15:15:28.687 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/dsa_core.ko 2024-01-24T15:15:28.687 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/tag_brcm.ko 2024-01-24T15:15:28.687 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/tag_dsa.ko 2024-01-24T15:15:28.687 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/tag_none.ko 2024-01-24T15:15:28.688 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/tag_trailer.ko 2024-01-24T15:15:28.688 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154 2024-01-24T15:15:28.688 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/6lowpan 2024-01-24T15:15:28.688 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-24T15:15:28.688 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/ieee802154.ko 2024-01-24T15:15:28.688 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-24T15:15:28.688 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4 2024-01-24T15:15:28.688 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ah4.ko 2024-01-24T15:15:28.688 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/esp4.ko 2024-01-24T15:15:28.688 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/fou.ko 2024-01-24T15:15:28.688 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/gre.ko 2024-01-24T15:15:28.688 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/inet_diag.ko 2024-01-24T15:15:28.688 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ip_gre.ko 2024-01-24T15:15:28.688 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ip_tunnel.ko 2024-01-24T15:15:28.689 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ip_vti.ko 2024-01-24T15:15:28.689 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ipcomp.ko 2024-01-24T15:15:28.689 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ipip.ko 2024-01-24T15:15:28.689 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter 2024-01-24T15:15:28.689 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-24T15:15:28.689 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-24T15:15:28.689 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-24T15:15:28.689 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-24T15:15:28.689 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-24T15:15:28.689 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-24T15:15:28.689 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-24T15:15:28.689 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-24T15:15:28.689 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-24T15:15:28.689 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-24T15:15:28.689 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-24T15:15:28.690 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-24T15:15:28.690 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-24T15:15:28.690 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-24T15:15:28.690 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-24T15:15:28.690 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-24T15:15:28.690 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-24T15:15:28.690 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-24T15:15:28.690 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-24T15:15:28.690 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-24T15:15:28.690 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-24T15:15:28.690 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_bic.ko 2024-01-24T15:15:28.690 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_dctcp.ko 2024-01-24T15:15:28.690 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_diag.ko 2024-01-24T15:15:28.690 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_highspeed.ko 2024-01-24T15:15:28.691 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_htcp.ko 2024-01-24T15:15:28.691 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_hybla.ko 2024-01-24T15:15:28.691 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_illinois.ko 2024-01-24T15:15:28.691 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_lp.ko 2024-01-24T15:15:28.691 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_scalable.ko 2024-01-24T15:15:28.691 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_vegas.ko 2024-01-24T15:15:28.691 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_veno.ko 2024-01-24T15:15:28.691 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_westwood.ko 2024-01-24T15:15:28.691 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_yeah.ko 2024-01-24T15:15:28.691 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tunnel4.ko 2024-01-24T15:15:28.691 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/udp_diag.ko 2024-01-24T15:15:28.691 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/udp_tunnel.ko 2024-01-24T15:15:28.691 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-24T15:15:28.691 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6 2024-01-24T15:15:28.692 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ah6.ko 2024-01-24T15:15:28.692 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/esp6.ko 2024-01-24T15:15:28.692 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/fou6.ko 2024-01-24T15:15:28.692 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ip6_tunnel.ko 2024-01-24T15:15:28.692 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-24T15:15:28.692 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ip6_vti.ko 2024-01-24T15:15:28.692 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ipcomp6.ko 2024-01-24T15:15:28.692 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter 2024-01-24T15:15:28.692 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-24T15:15:28.692 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-24T15:15:28.692 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-24T15:15:28.692 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-24T15:15:28.692 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-24T15:15:28.692 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-24T15:15:28.693 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-24T15:15:28.693 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-24T15:15:28.693 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-24T15:15:28.693 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-24T15:15:28.693 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-24T15:15:28.693 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-24T15:15:28.693 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-24T15:15:28.693 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-24T15:15:28.693 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-24T15:15:28.693 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-24T15:15:28.693 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-24T15:15:28.693 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-24T15:15:28.693 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-24T15:15:28.693 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-24T15:15:28.693 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-24T15:15:28.694 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-24T15:15:28.694 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-24T15:15:28.694 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-24T15:15:28.694 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/sit.ko 2024-01-24T15:15:28.694 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/tunnel6.ko 2024-01-24T15:15:28.694 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-24T15:15:28.694 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/key 2024-01-24T15:15:28.694 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/key/af_key.ko 2024-01-24T15:15:28.694 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp 2024-01-24T15:15:28.694 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_core.ko 2024-01-24T15:15:28.694 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-24T15:15:28.694 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_eth.ko 2024-01-24T15:15:28.694 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_ip.ko 2024-01-24T15:15:28.694 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_ip6.ko 2024-01-24T15:15:28.694 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_netlink.ko 2024-01-24T15:15:28.695 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_ppp.ko 2024-01-24T15:15:28.695 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/llc 2024-01-24T15:15:28.695 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/llc/llc.ko 2024-01-24T15:15:28.695 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/mac802154 2024-01-24T15:15:28.695 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/mac802154/mac802154.ko 2024-01-24T15:15:28.695 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/mpls 2024-01-24T15:15:28.695 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/mpls/mpls_gso.ko 2024-01-24T15:15:28.695 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter 2024-01-24T15:15:28.695 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset 2024-01-24T15:15:28.695 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set.ko 2024-01-24T15:15:28.695 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-24T15:15:28.695 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-24T15:15:28.695 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-24T15:15:28.695 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-24T15:15:28.695 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-24T15:15:28.696 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-24T15:15:28.696 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-24T15:15:28.696 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-24T15:15:28.696 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-24T15:15:28.696 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-24T15:15:28.696 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-24T15:15:28.696 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-24T15:15:28.696 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-24T15:15:28.696 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-24T15:15:28.696 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-24T15:15:28.696 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs 2024-01-24T15:15:28.696 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-24T15:15:28.696 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-24T15:15:28.696 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-24T15:15:28.697 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-24T15:15:28.697 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-24T15:15:28.697 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-24T15:15:28.697 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-24T15:15:28.697 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-24T15:15:28.697 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-24T15:15:28.697 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-24T15:15:28.697 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-24T15:15:28.697 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-24T15:15:28.697 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-24T15:15:28.697 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-24T15:15:28.697 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conncount.ko 2024-01-24T15:15:28.697 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack.ko 2024-01-24T15:15:28.697 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-24T15:15:28.698 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-24T15:15:28.698 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-24T15:15:28.698 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-24T15:15:28.698 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-24T15:15:28.698 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-24T15:15:28.698 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-24T15:15:28.698 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-24T15:15:28.698 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-24T15:15:28.698 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-24T15:15:28.698 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-24T15:15:28.698 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-24T15:15:28.698 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-24T15:15:28.698 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_flow_table.ko 2024-01-24T15:15:28.698 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-24T15:15:28.698 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_log_syslog.ko 2024-01-24T15:15:28.699 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat.ko 2024-01-24T15:15:28.699 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-24T15:15:28.699 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-24T15:15:28.699 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_irc.ko 2024-01-24T15:15:28.699 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_sip.ko 2024-01-24T15:15:28.699 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-24T15:15:28.699 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-24T15:15:28.699 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_tables.ko 2024-01-24T15:15:28.699 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink.ko 2024-01-24T15:15:28.699 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-24T15:15:28.699 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_log.ko 2024-01-24T15:15:28.699 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-24T15:15:28.699 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-24T15:15:28.699 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_chain_nat.ko 2024-01-24T15:15:28.699 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_compat.ko 2024-01-24T15:15:28.700 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_ct.ko 2024-01-24T15:15:28.700 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-24T15:15:28.700 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_fib.ko 2024-01-24T15:15:28.700 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-24T15:15:28.700 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_hash.ko 2024-01-24T15:15:28.700 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_limit.ko 2024-01-24T15:15:28.700 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_log.ko 2024-01-24T15:15:28.700 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_masq.ko 2024-01-24T15:15:28.700 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_nat.ko 2024-01-24T15:15:28.700 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_numgen.ko 2024-01-24T15:15:28.700 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_queue.ko 2024-01-24T15:15:28.700 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_quota.ko 2024-01-24T15:15:28.700 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_redir.ko 2024-01-24T15:15:28.700 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_reject.ko 2024-01-24T15:15:28.701 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_reject_inet.ko 2024-01-24T15:15:28.701 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_socket.ko 2024-01-24T15:15:28.701 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_tunnel.ko 2024-01-24T15:15:28.701 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_AUDIT.ko 2024-01-24T15:15:28.701 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-24T15:15:28.701 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-24T15:15:28.701 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-24T15:15:28.701 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_CT.ko 2024-01-24T15:15:28.701 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_DSCP.ko 2024-01-24T15:15:28.701 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_HL.ko 2024-01-24T15:15:28.701 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_HMARK.ko 2024-01-24T15:15:28.701 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-24T15:15:28.701 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_LED.ko 2024-01-24T15:15:28.701 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_LOG.ko 2024-01-24T15:15:28.701 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-24T15:15:28.702 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_NETMAP.ko 2024-01-24T15:15:28.702 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_NFLOG.ko 2024-01-24T15:15:28.702 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-24T15:15:28.702 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_RATEEST.ko 2024-01-24T15:15:28.702 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-24T15:15:28.702 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_SECMARK.ko 2024-01-24T15:15:28.702 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-24T15:15:28.702 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-24T15:15:28.702 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TEE.ko 2024-01-24T15:15:28.702 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TPROXY.ko 2024-01-24T15:15:28.702 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TRACE.ko 2024-01-24T15:15:28.702 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_addrtype.ko 2024-01-24T15:15:28.702 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_bpf.ko 2024-01-24T15:15:28.702 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_cgroup.ko 2024-01-24T15:15:28.703 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_cluster.ko 2024-01-24T15:15:28.703 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_comment.ko 2024-01-24T15:15:28.703 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_connbytes.ko 2024-01-24T15:15:28.703 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_connlabel.ko 2024-01-24T15:15:28.703 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_connlimit.ko 2024-01-24T15:15:28.703 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_connmark.ko 2024-01-24T15:15:28.703 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_conntrack.ko 2024-01-24T15:15:28.703 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_cpu.ko 2024-01-24T15:15:28.703 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_dccp.ko 2024-01-24T15:15:28.703 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_devgroup.ko 2024-01-24T15:15:28.703 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_dscp.ko 2024-01-24T15:15:28.703 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_ecn.ko 2024-01-24T15:15:28.703 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_esp.ko 2024-01-24T15:15:28.703 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_hashlimit.ko 2024-01-24T15:15:28.703 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_helper.ko 2024-01-24T15:15:28.704 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_hl.ko 2024-01-24T15:15:28.704 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_ipcomp.ko 2024-01-24T15:15:28.704 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_iprange.ko 2024-01-24T15:15:28.704 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_ipvs.ko 2024-01-24T15:15:28.704 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_l2tp.ko 2024-01-24T15:15:28.704 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_length.ko 2024-01-24T15:15:28.704 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_limit.ko 2024-01-24T15:15:28.704 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_mac.ko 2024-01-24T15:15:28.704 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_mark.ko 2024-01-24T15:15:28.704 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_multiport.ko 2024-01-24T15:15:28.704 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_nat.ko 2024-01-24T15:15:28.704 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_nfacct.ko 2024-01-24T15:15:28.704 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_osf.ko 2024-01-24T15:15:28.705 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_owner.ko 2024-01-24T15:15:28.705 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_physdev.ko 2024-01-24T15:15:28.705 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_pkttype.ko 2024-01-24T15:15:28.705 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_policy.ko 2024-01-24T15:15:28.705 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_quota.ko 2024-01-24T15:15:28.705 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_rateest.ko 2024-01-24T15:15:28.705 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_realm.ko 2024-01-24T15:15:28.705 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_recent.ko 2024-01-24T15:15:28.705 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_sctp.ko 2024-01-24T15:15:28.705 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_set.ko 2024-01-24T15:15:28.705 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_socket.ko 2024-01-24T15:15:28.705 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_state.ko 2024-01-24T15:15:28.705 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_statistic.ko 2024-01-24T15:15:28.705 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_string.ko 2024-01-24T15:15:28.705 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_tcpmss.ko 2024-01-24T15:15:28.706 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_time.ko 2024-01-24T15:15:28.706 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_u32.ko 2024-01-24T15:15:28.706 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netlink 2024-01-24T15:15:28.706 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netlink/netlink_diag.ko 2024-01-24T15:15:28.706 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/nsh 2024-01-24T15:15:28.706 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/nsh/nsh.ko 2024-01-24T15:15:28.706 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch 2024-01-24T15:15:28.706 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/openvswitch.ko 2024-01-24T15:15:28.706 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/vport-geneve.ko 2024-01-24T15:15:28.706 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/vport-gre.ko 2024-01-24T15:15:28.706 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/vport-vxlan.ko 2024-01-24T15:15:28.706 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/packet 2024-01-24T15:15:28.706 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/packet/af_packet_diag.ko 2024-01-24T15:15:28.706 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/rds 2024-01-24T15:15:28.706 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/rds/rds.ko 2024-01-24T15:15:28.707 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/rds/rds_rdma.ko 2024-01-24T15:15:28.707 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/rds/rds_tcp.ko 2024-01-24T15:15:28.707 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched 2024-01-24T15:15:28.707 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_csum.ko 2024-01-24T15:15:28.707 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_gact.ko 2024-01-24T15:15:28.707 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_ipt.ko 2024-01-24T15:15:28.707 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_mirred.ko 2024-01-24T15:15:28.707 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_nat.ko 2024-01-24T15:15:28.707 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_pedit.ko 2024-01-24T15:15:28.707 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_police.ko 2024-01-24T15:15:28.707 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_simple.ko 2024-01-24T15:15:28.707 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_skbedit.ko 2024-01-24T15:15:28.707 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_vlan.ko 2024-01-24T15:15:28.707 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_basic.ko 2024-01-24T15:15:28.707 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_bpf.ko 2024-01-24T15:15:28.708 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_flow.ko 2024-01-24T15:15:28.708 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_fw.ko 2024-01-24T15:15:28.708 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_route.ko 2024-01-24T15:15:28.708 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_u32.ko 2024-01-24T15:15:28.708 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_cmp.ko 2024-01-24T15:15:28.708 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_ipset.ko 2024-01-24T15:15:28.708 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_meta.ko 2024-01-24T15:15:28.708 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_nbyte.ko 2024-01-24T15:15:28.708 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_text.ko 2024-01-24T15:15:28.708 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_u32.ko 2024-01-24T15:15:28.708 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_choke.ko 2024-01-24T15:15:28.708 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_codel.ko 2024-01-24T15:15:28.708 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_drr.ko 2024-01-24T15:15:28.708 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_fq.ko 2024-01-24T15:15:28.709 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_gred.ko 2024-01-24T15:15:28.709 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_hfsc.ko 2024-01-24T15:15:28.709 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_hhf.ko 2024-01-24T15:15:28.709 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_htb.ko 2024-01-24T15:15:28.709 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_ingress.ko 2024-01-24T15:15:28.709 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_mqprio.ko 2024-01-24T15:15:28.709 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_mqprio_lib.ko 2024-01-24T15:15:28.709 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_multiq.ko 2024-01-24T15:15:28.709 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_netem.ko 2024-01-24T15:15:28.709 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_pie.ko 2024-01-24T15:15:28.709 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_plug.ko 2024-01-24T15:15:28.709 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_prio.ko 2024-01-24T15:15:28.709 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_qfq.ko 2024-01-24T15:15:28.709 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_red.ko 2024-01-24T15:15:28.709 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_sfb.ko 2024-01-24T15:15:28.710 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_sfq.ko 2024-01-24T15:15:28.710 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_tbf.ko 2024-01-24T15:15:28.710 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_teql.ko 2024-01-24T15:15:28.710 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sctp 2024-01-24T15:15:28.710 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sctp/sctp.ko 2024-01-24T15:15:28.710 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sctp/sctp_diag.ko 2024-01-24T15:15:28.710 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc 2024-01-24T15:15:28.710 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/auth_gss 2024-01-24T15:15:28.710 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-24T15:15:28.710 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-24T15:15:28.710 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/sunrpc.ko 2024-01-24T15:15:28.710 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/xprtrdma 2024-01-24T15:15:28.710 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-24T15:15:28.710 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/tipc 2024-01-24T15:15:28.711 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/tipc/diag.ko 2024-01-24T15:15:28.711 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/tipc/tipc.ko 2024-01-24T15:15:28.711 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/unix 2024-01-24T15:15:28.711 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/unix/unix_diag.ko 2024-01-24T15:15:28.711 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock 2024-01-24T15:15:28.711 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-24T15:15:28.711 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-24T15:15:28.711 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vsock.ko 2024-01-24T15:15:28.711 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-24T15:15:28.711 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-24T15:15:28.711 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/xfrm 2024-01-24T15:15:28.711 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-24T15:15:28.711 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/security 2024-01-24T15:15:28.711 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/security/keys 2024-01-24T15:15:28.711 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/security/keys/encrypted-keys 2024-01-24T15:15:28.712 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-01-24T15:15:28.712 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/security/keys/trusted-keys 2024-01-24T15:15:28.712 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/security/keys/trusted-keys/trusted.ko 2024-01-24T15:15:28.712 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/virt 2024-01-24T15:15:28.712 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/virt/lib 2024-01-24T15:15:28.712 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/virt/lib/irqbypass.ko 2024-01-24T15:15:28.712 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/modules.alias 2024-01-24T15:15:28.712 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/modules.alias.bin 2024-01-24T15:15:28.712 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/modules.builtin 2024-01-24T15:15:28.712 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/modules.builtin.bin 2024-01-24T15:15:28.712 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/modules.builtin.modinfo 2024-01-24T15:15:28.712 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/modules.dep 2024-01-24T15:15:28.712 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/modules.dep.bin 2024-01-24T15:15:28.712 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/modules.devname 2024-01-24T15:15:28.712 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/modules.order 2024-01-24T15:15:28.713 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/modules.softdep 2024-01-24T15:15:28.713 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/modules.symbols 2024-01-24T15:15:28.713 INFO:teuthology.orchestra.run.smithi204.stdout:/lib/modules/6.7.0-gf2d346040895/modules.symbols.bin 2024-01-24T15:15:28.713 DEBUG:teuthology.task.kernel:get_image_version: 6.7.0-gf2d346040895 2024-01-24T15:15:28.713 DEBUG:teuthology.orchestra.run.smithi204:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-01-24T15:15:28.736 INFO:teuthology.orchestra.run.smithi204.stdout:postinstall scriptlet (using /bin/sh): 2024-01-24T15:15:28.736 INFO:teuthology.orchestra.run.smithi204.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.7.0-gf2d346040895 -a -r /boot/System.map-6.7.0-gf2d346040895 ]; then 2024-01-24T15:15:28.736 INFO:teuthology.orchestra.run.smithi204.stdout:cp /boot/vmlinuz-6.7.0-gf2d346040895 /boot/.vmlinuz-6.7.0-gf2d346040895-rpm 2024-01-24T15:15:28.736 INFO:teuthology.orchestra.run.smithi204.stdout:cp /boot/System.map-6.7.0-gf2d346040895 /boot/.System.map-6.7.0-gf2d346040895-rpm 2024-01-24T15:15:28.737 INFO:teuthology.orchestra.run.smithi204.stdout:rm -f /boot/vmlinuz-6.7.0-gf2d346040895 /boot/System.map-6.7.0-gf2d346040895 2024-01-24T15:15:28.737 INFO:teuthology.orchestra.run.smithi204.stdout:/sbin/installkernel 6.7.0-gf2d346040895 /boot/.vmlinuz-6.7.0-gf2d346040895-rpm /boot/.System.map-6.7.0-gf2d346040895-rpm 2024-01-24T15:15:28.737 INFO:teuthology.orchestra.run.smithi204.stdout:rm -f /boot/.vmlinuz-6.7.0-gf2d346040895-rpm /boot/.System.map-6.7.0-gf2d346040895-rpm 2024-01-24T15:15:28.737 INFO:teuthology.orchestra.run.smithi204.stdout:fi 2024-01-24T15:15:28.737 INFO:teuthology.orchestra.run.smithi204.stdout:preuninstall scriptlet (using /bin/sh): 2024-01-24T15:15:28.737 INFO:teuthology.orchestra.run.smithi204.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-01-24T15:15:28.737 INFO:teuthology.orchestra.run.smithi204.stdout:new-kernel-pkg --remove 6.7.0-gf2d346040895 --rminitrd --initrdfile=/boot/initramfs-6.7.0-gf2d346040895.img 2024-01-24T15:15:28.737 INFO:teuthology.orchestra.run.smithi204.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-01-24T15:15:28.737 INFO:teuthology.orchestra.run.smithi204.stdout:kernel-install remove 6.7.0-gf2d346040895 2024-01-24T15:15:28.737 INFO:teuthology.orchestra.run.smithi204.stdout:fi 2024-01-24T15:15:28.737 INFO:teuthology.orchestra.run.smithi204.stdout:postuninstall scriptlet (using /bin/sh): 2024-01-24T15:15:28.737 INFO:teuthology.orchestra.run.smithi204.stdout:if [ -x /sbin/update-bootloader ]; then 2024-01-24T15:15:28.737 INFO:teuthology.orchestra.run.smithi204.stdout:/sbin/update-bootloader --remove 6.7.0-gf2d346040895 2024-01-24T15:15:28.737 INFO:teuthology.orchestra.run.smithi204.stdout:fi 2024-01-24T15:15:28.738 DEBUG:teuthology.orchestra.run.smithi204:> sudo rpm -qi grub2-tools 2024-01-24T15:15:28.811 INFO:teuthology.orchestra.run.smithi204.stdout:Name : grub2-tools 2024-01-24T15:15:28.812 INFO:teuthology.orchestra.run.smithi204.stdout:Epoch : 1 2024-01-24T15:15:28.812 INFO:teuthology.orchestra.run.smithi204.stdout:Version : 2.02 2024-01-24T15:15:28.812 INFO:teuthology.orchestra.run.smithi204.stdout:Release : 123.el8 2024-01-24T15:15:28.812 INFO:teuthology.orchestra.run.smithi204.stdout:Architecture: x86_64 2024-01-24T15:15:28.812 INFO:teuthology.orchestra.run.smithi204.stdout:Install Date: Thu 14 Dec 2023 12:39:42 AM UTC 2024-01-24T15:15:28.812 INFO:teuthology.orchestra.run.smithi204.stdout:Group : System Environment/Base 2024-01-24T15:15:28.812 INFO:teuthology.orchestra.run.smithi204.stdout:Size : 9265450 2024-01-24T15:15:28.812 INFO:teuthology.orchestra.run.smithi204.stdout:License : GPLv3+ 2024-01-24T15:15:28.812 INFO:teuthology.orchestra.run.smithi204.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2024-01-24T15:15:28.812 INFO:teuthology.orchestra.run.smithi204.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2024-01-24T15:15:28.812 INFO:teuthology.orchestra.run.smithi204.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2024-01-24T15:15:28.812 INFO:teuthology.orchestra.run.smithi204.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2024-01-24T15:15:28.812 INFO:teuthology.orchestra.run.smithi204.stdout:Relocations : (not relocatable) 2024-01-24T15:15:28.812 INFO:teuthology.orchestra.run.smithi204.stdout:Packager : Red Hat, Inc. 2024-01-24T15:15:28.813 INFO:teuthology.orchestra.run.smithi204.stdout:Vendor : Red Hat, Inc. 2024-01-24T15:15:28.813 INFO:teuthology.orchestra.run.smithi204.stdout:URL : http://www.gnu.org/software/grub/ 2024-01-24T15:15:28.813 INFO:teuthology.orchestra.run.smithi204.stdout:Summary : Support tools for GRUB. 2024-01-24T15:15:28.813 INFO:teuthology.orchestra.run.smithi204.stdout:Description : 2024-01-24T15:15:28.813 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-01-24T15:15:28.813 INFO:teuthology.orchestra.run.smithi204.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-01-24T15:15:28.813 INFO:teuthology.orchestra.run.smithi204.stdout:customizable bootloader with modular architecture. It supports a rich 2024-01-24T15:15:28.813 INFO:teuthology.orchestra.run.smithi204.stdout:variety of kernel formats, file systems, computer architectures and 2024-01-24T15:15:28.813 INFO:teuthology.orchestra.run.smithi204.stdout:hardware devices. 2024-01-24T15:15:28.813 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-01-24T15:15:28.813 INFO:teuthology.orchestra.run.smithi204.stdout:This subpackage provides tools for support of all platforms. 2024-01-24T15:15:28.814 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-01-24T15:15:28.814 INFO:teuthology.task.kernel:Updating grub on smithi204 to boot 6.7.0-gf2d346040895 2024-01-24T15:15:28.814 DEBUG:teuthology.orchestra.run.smithi204:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-01-24T15:15:29.638 INFO:teuthology.orchestra.run.smithi204.stderr:Generating grub configuration file ... 2024-01-24T15:15:31.550 INFO:teuthology.orchestra.run.smithi204.stderr:done 2024-01-24T15:15:31.552 DEBUG:teuthology.orchestra.run.smithi204:> mktemp 2024-01-24T15:15:31.590 INFO:teuthology.orchestra.run.smithi204.stdout:/tmp/tmp.0RAXPnDs2k 2024-01-24T15:15:31.590 DEBUG:teuthology.orchestra.run.smithi204:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0RAXPnDs2k 2024-01-24T15:15:31.664 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 0666 /tmp/tmp.0RAXPnDs2k 2024-01-24T15:15:31.867 DEBUG:teuthology.orchestra.remote:smithi204:/tmp/tmp.0RAXPnDs2k is 6KB 2024-01-24T15:15:31.915 DEBUG:teuthology.orchestra.run.smithi204:> rm -fr /tmp/tmp.0RAXPnDs2k 2024-01-24T15:15:31.932 DEBUG:teuthology.orchestra.run.smithi204:> sudo /bin/ls /boot/loader/entries || true 2024-01-24T15:15:32.009 INFO:teuthology.orchestra.run.smithi204.stdout:2db68f91c8f90721a6596efe657a5324-0-rescue.conf 2024-01-24T15:15:32.009 INFO:teuthology.orchestra.run.smithi204.stdout:2db68f91c8f90721a6596efe657a5324-6.7.0-gf2d346040895.conf 2024-01-24T15:15:32.009 INFO:teuthology.orchestra.run.smithi204.stdout:963f8b6c99184de696879b3f7da9ecce-0-rescue.conf 2024-01-24T15:15:32.009 INFO:teuthology.orchestra.run.smithi204.stdout:963f8b6c99184de696879b3f7da9ecce-4.18.0-372.9.1.el8.x86_64.conf 2024-01-24T15:15:32.010 INFO:teuthology.orchestra.run.smithi204.stdout:963f8b6c99184de696879b3f7da9ecce-4.18.0-513.9.1.el8_9.x86_64.conf 2024-01-24T15:15:32.011 DEBUG:teuthology.orchestra.run.smithi204:> sudo grub2-set-default 2db68f91c8f90721a6596efe657a5324-6.7.0-gf2d346040895 2024-01-24T15:15:32.187 DEBUG:teuthology.orchestra.run.smithi204:> sudo shutdown -r now 2024-01-24T15:15:35.741 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi160.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-01-24T15:15:35.741 DEBUG:teuthology.orchestra.run.smithi160:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-01-24T15:15:35.799 INFO:teuthology.orchestra.run.smithi160.stdout:/boot/System.map-6.7.0-gf2d346040895 2024-01-24T15:15:35.799 INFO:teuthology.orchestra.run.smithi160.stdout:/boot/config-6.7.0-gf2d346040895 2024-01-24T15:15:35.800 INFO:teuthology.orchestra.run.smithi160.stdout:/boot/vmlinuz-6.7.0-gf2d346040895 2024-01-24T15:15:35.800 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895 2024-01-24T15:15:35.800 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel 2024-01-24T15:15:35.800 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch 2024-01-24T15:15:35.800 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86 2024-01-24T15:15:35.800 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto 2024-01-24T15:15:35.800 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-24T15:15:35.800 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-24T15:15:35.800 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-24T15:15:35.800 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-24T15:15:35.800 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-24T15:15:35.800 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-24T15:15:35.800 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-24T15:15:35.801 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/crc32c-intel.ko 2024-01-24T15:15:35.801 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-24T15:15:35.801 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-24T15:15:35.801 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-24T15:15:35.801 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-24T15:15:35.803 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-24T15:15:35.803 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-24T15:15:35.803 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-24T15:15:35.803 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-24T15:15:35.803 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-24T15:15:35.803 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-24T15:15:35.803 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-24T15:15:35.803 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-24T15:15:35.803 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel 2024-01-24T15:15:35.803 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/cpu 2024-01-24T15:15:35.803 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/cpu/mce 2024-01-24T15:15:35.804 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-24T15:15:35.804 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kvm 2024-01-24T15:15:35.804 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-24T15:15:35.804 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-24T15:15:35.804 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/arch/x86/kvm/kvm.ko 2024-01-24T15:15:35.804 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto 2024-01-24T15:15:35.804 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/ansi_cprng.ko 2024-01-24T15:15:35.804 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/anubis.ko 2024-01-24T15:15:35.804 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/arc4.ko 2024-01-24T15:15:35.804 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx 2024-01-24T15:15:35.804 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_memcpy.ko 2024-01-24T15:15:35.804 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_pq.ko 2024-01-24T15:15:35.804 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-24T15:15:35.804 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_tx.ko 2024-01-24T15:15:35.805 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/async_xor.ko 2024-01-24T15:15:35.805 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/async_tx/raid6test.ko 2024-01-24T15:15:35.805 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/authenc.ko 2024-01-24T15:15:35.805 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/authencesn.ko 2024-01-24T15:15:35.805 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/blake2b_generic.ko 2024-01-24T15:15:35.805 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/blowfish_common.ko 2024-01-24T15:15:35.805 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/blowfish_generic.ko 2024-01-24T15:15:35.805 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/camellia_generic.ko 2024-01-24T15:15:35.805 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/cast5_generic.ko 2024-01-24T15:15:35.805 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/cast6_generic.ko 2024-01-24T15:15:35.805 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/cast_common.ko 2024-01-24T15:15:35.805 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/ccm.ko 2024-01-24T15:15:35.805 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/cmac.ko 2024-01-24T15:15:35.805 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/crc32_generic.ko 2024-01-24T15:15:35.805 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/crypto_engine.ko 2024-01-24T15:15:35.805 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/crypto_user.ko 2024-01-24T15:15:35.806 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/cts.ko 2024-01-24T15:15:35.806 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/des_generic.ko 2024-01-24T15:15:35.806 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/dh_generic.ko 2024-01-24T15:15:35.806 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/echainiv.ko 2024-01-24T15:15:35.806 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/essiv.ko 2024-01-24T15:15:35.806 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/fcrypt.ko 2024-01-24T15:15:35.806 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/khazad.ko 2024-01-24T15:15:35.806 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/lz4.ko 2024-01-24T15:15:35.806 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/lz4hc.ko 2024-01-24T15:15:35.806 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/md4.ko 2024-01-24T15:15:35.806 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/michael_mic.ko 2024-01-24T15:15:35.806 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/pcbc.ko 2024-01-24T15:15:35.806 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/pcrypt.ko 2024-01-24T15:15:35.806 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/rmd160.ko 2024-01-24T15:15:35.806 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/seed.ko 2024-01-24T15:15:35.806 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/serpent_generic.ko 2024-01-24T15:15:35.807 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/tcrypt.ko 2024-01-24T15:15:35.807 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/tea.ko 2024-01-24T15:15:35.807 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/twofish_common.ko 2024-01-24T15:15:35.807 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/twofish_generic.ko 2024-01-24T15:15:35.807 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/vmac.ko 2024-01-24T15:15:35.807 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/wp512.ko 2024-01-24T15:15:35.807 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/xcbc.ko 2024-01-24T15:15:35.807 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/xor.ko 2024-01-24T15:15:35.807 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/crypto/xxhash_generic.ko 2024-01-24T15:15:35.807 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers 2024-01-24T15:15:35.807 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi 2024-01-24T15:15:35.807 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-24T15:15:35.807 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/acpi_pad.ko 2024-01-24T15:15:35.807 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/custom_method.ko 2024-01-24T15:15:35.808 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/ec_sys.ko 2024-01-24T15:15:35.808 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/platform_profile.ko 2024-01-24T15:15:35.808 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/sbs.ko 2024-01-24T15:15:35.808 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/sbshc.ko 2024-01-24T15:15:35.808 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/acpi/video.ko 2024-01-24T15:15:35.808 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata 2024-01-24T15:15:35.808 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/acard-ahci.ko 2024-01-24T15:15:35.808 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/ahci_platform.ko 2024-01-24T15:15:35.808 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/ata_generic.ko 2024-01-24T15:15:35.808 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/libahci_platform.ko 2024-01-24T15:15:35.808 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_acpi.ko 2024-01-24T15:15:35.808 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_ali.ko 2024-01-24T15:15:35.808 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_amd.ko 2024-01-24T15:15:35.808 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_artop.ko 2024-01-24T15:15:35.808 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_atiixp.ko 2024-01-24T15:15:35.809 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_atp867x.ko 2024-01-24T15:15:35.809 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_cmd640.ko 2024-01-24T15:15:35.809 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_cmd64x.ko 2024-01-24T15:15:35.809 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_cypress.ko 2024-01-24T15:15:35.809 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_efar.ko 2024-01-24T15:15:35.809 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_hpt366.ko 2024-01-24T15:15:35.809 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_hpt37x.ko 2024-01-24T15:15:35.809 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-24T15:15:35.809 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-24T15:15:35.809 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_it8213.ko 2024-01-24T15:15:35.809 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_it821x.ko 2024-01-24T15:15:35.809 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_jmicron.ko 2024-01-24T15:15:35.809 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_marvell.ko 2024-01-24T15:15:35.810 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_mpiix.ko 2024-01-24T15:15:35.810 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_netcell.ko 2024-01-24T15:15:35.810 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_ninja32.ko 2024-01-24T15:15:35.810 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_ns87410.ko 2024-01-24T15:15:35.810 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_ns87415.ko 2024-01-24T15:15:35.810 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_oldpiix.ko 2024-01-24T15:15:35.810 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_opti.ko 2024-01-24T15:15:35.810 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_optidma.ko 2024-01-24T15:15:35.810 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_pcmcia.ko 2024-01-24T15:15:35.810 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-24T15:15:35.810 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-24T15:15:35.810 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_piccolo.ko 2024-01-24T15:15:35.810 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_rdc.ko 2024-01-24T15:15:35.811 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_sch.ko 2024-01-24T15:15:35.811 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_serverworks.ko 2024-01-24T15:15:35.811 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_sil680.ko 2024-01-24T15:15:35.811 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_sis.ko 2024-01-24T15:15:35.811 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_sl82c105.ko 2024-01-24T15:15:35.811 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_triflex.ko 2024-01-24T15:15:35.811 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pata_via.ko 2024-01-24T15:15:35.811 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/pdc_adma.ko 2024-01-24T15:15:35.811 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_inic162x.ko 2024-01-24T15:15:35.811 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_mv.ko 2024-01-24T15:15:35.811 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_nv.ko 2024-01-24T15:15:35.811 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_promise.ko 2024-01-24T15:15:35.811 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_qstor.ko 2024-01-24T15:15:35.812 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_sil.ko 2024-01-24T15:15:35.812 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_sil24.ko 2024-01-24T15:15:35.812 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_sis.ko 2024-01-24T15:15:35.812 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_svw.ko 2024-01-24T15:15:35.812 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_sx4.ko 2024-01-24T15:15:35.812 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_uli.ko 2024-01-24T15:15:35.812 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_via.ko 2024-01-24T15:15:35.812 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ata/sata_vsc.ko 2024-01-24T15:15:35.812 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/auxdisplay 2024-01-24T15:15:35.812 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/auxdisplay/ks0108.ko 2024-01-24T15:15:35.812 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/base 2024-01-24T15:15:35.812 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/base/regmap 2024-01-24T15:15:35.812 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/base/regmap/regmap-i2c.ko 2024-01-24T15:15:35.813 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/base/regmap/regmap-mmio.ko 2024-01-24T15:15:35.813 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/bcma 2024-01-24T15:15:35.813 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/bcma/bcma.ko 2024-01-24T15:15:35.813 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block 2024-01-24T15:15:35.813 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/aoe 2024-01-24T15:15:35.813 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/aoe/aoe.ko 2024-01-24T15:15:35.813 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/brd.ko 2024-01-24T15:15:35.813 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/drbd 2024-01-24T15:15:35.813 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/drbd/drbd.ko 2024-01-24T15:15:35.813 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/floppy.ko 2024-01-24T15:15:35.813 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/loop.ko 2024-01-24T15:15:35.813 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/mtip32xx 2024-01-24T15:15:35.813 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-24T15:15:35.813 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/nbd.ko 2024-01-24T15:15:35.814 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/null_blk 2024-01-24T15:15:35.814 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/null_blk/null_blk.ko 2024-01-24T15:15:35.814 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/pktcdvd.ko 2024-01-24T15:15:35.814 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/rbd.ko 2024-01-24T15:15:35.814 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/virtio_blk.ko 2024-01-24T15:15:35.814 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/xen-blkback 2024-01-24T15:15:35.814 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-24T15:15:35.814 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/xen-blkfront.ko 2024-01-24T15:15:35.814 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/zram 2024-01-24T15:15:35.814 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/block/zram/zram.ko 2024-01-24T15:15:35.814 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char 2024-01-24T15:15:35.814 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hangcheck-timer.ko 2024-01-24T15:15:35.814 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random 2024-01-24T15:15:35.814 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-24T15:15:35.815 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-24T15:15:35.815 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-24T15:15:35.815 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/via-rng.ko 2024-01-24T15:15:35.815 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-24T15:15:35.815 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi 2024-01-24T15:15:35.815 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-24T15:15:35.815 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-24T15:15:35.815 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-24T15:15:35.815 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-24T15:15:35.815 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-24T15:15:35.815 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-24T15:15:35.815 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/lp.ko 2024-01-24T15:15:35.815 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/mwave 2024-01-24T15:15:35.815 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/mwave/mwave.ko 2024-01-24T15:15:35.816 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/ppdev.ko 2024-01-24T15:15:35.816 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tlclk.ko 2024-01-24T15:15:35.816 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm 2024-01-24T15:15:35.816 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm.ko 2024-01-24T15:15:35.816 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-24T15:15:35.816 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-24T15:15:35.816 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-24T15:15:35.816 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_tis.ko 2024-01-24T15:15:35.816 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-01-24T15:15:35.816 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/uv_mmtimer.ko 2024-01-24T15:15:35.816 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/char/virtio_console.ko 2024-01-24T15:15:35.816 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq 2024-01-24T15:15:35.817 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-01-24T15:15:35.817 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-24T15:15:35.817 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-24T15:15:35.817 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-01-24T15:15:35.817 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/powernow-k8.ko 2024-01-24T15:15:35.817 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-24T15:15:35.817 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto 2024-01-24T15:15:35.817 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/ccp 2024-01-24T15:15:35.817 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-24T15:15:35.817 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/ccp/ccp.ko 2024-01-24T15:15:35.817 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel 2024-01-24T15:15:35.817 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat 2024-01-24T15:15:35.817 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/qat_common 2024-01-24T15:15:35.818 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-24T15:15:35.818 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-01-24T15:15:35.818 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-24T15:15:35.818 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/padlock-aes.ko 2024-01-24T15:15:35.818 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/padlock-sha.ko 2024-01-24T15:15:35.818 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/virtio 2024-01-24T15:15:35.818 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-24T15:15:35.818 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/dca 2024-01-24T15:15:35.818 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/dca/dca.ko 2024-01-24T15:15:35.818 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/devfreq 2024-01-24T15:15:35.818 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-01-24T15:15:35.818 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma 2024-01-24T15:15:35.818 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/dw 2024-01-24T15:15:35.818 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-24T15:15:35.818 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/ioat 2024-01-24T15:15:35.819 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-24T15:15:35.819 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac 2024-01-24T15:15:35.819 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/amd64_edac.ko 2024-01-24T15:15:35.819 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/e752x_edac.ko 2024-01-24T15:15:35.819 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/edac_mce_amd.ko 2024-01-24T15:15:35.819 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i3000_edac.ko 2024-01-24T15:15:35.819 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i3200_edac.ko 2024-01-24T15:15:35.819 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i5100_edac.ko 2024-01-24T15:15:35.819 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i5400_edac.ko 2024-01-24T15:15:35.819 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i7300_edac.ko 2024-01-24T15:15:35.819 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i7core_edac.ko 2024-01-24T15:15:35.819 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/i82975x_edac.ko 2024-01-24T15:15:35.819 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/ie31200_edac.ko 2024-01-24T15:15:35.820 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/sb_edac.ko 2024-01-24T15:15:35.820 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/edac/x38_edac.ko 2024-01-24T15:15:35.820 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/firmware 2024-01-24T15:15:35.820 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/firmware/edd.ko 2024-01-24T15:15:35.820 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-24T15:15:35.820 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio 2024-01-24T15:15:35.820 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-ich.ko 2024-01-24T15:15:35.820 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-24T15:15:35.820 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid 2024-01-24T15:15:35.820 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-appleir.ko 2024-01-24T15:15:35.820 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-aureal.ko 2024-01-24T15:15:35.820 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-axff.ko 2024-01-24T15:15:35.820 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-dr.ko 2024-01-24T15:15:35.820 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-elecom.ko 2024-01-24T15:15:35.821 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-elo.ko 2024-01-24T15:15:35.821 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-emsff.ko 2024-01-24T15:15:35.821 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-gaff.ko 2024-01-24T15:15:35.821 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-gt683r.ko 2024-01-24T15:15:35.821 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-gyration.ko 2024-01-24T15:15:35.821 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-24T15:15:35.821 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-24T15:15:35.821 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-holtekff.ko 2024-01-24T15:15:35.821 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-hyperv.ko 2024-01-24T15:15:35.821 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-icade.ko 2024-01-24T15:15:35.821 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-keytouch.ko 2024-01-24T15:15:35.821 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-kye.ko 2024-01-24T15:15:35.821 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-lcpower.ko 2024-01-24T15:15:35.821 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-led.ko 2024-01-24T15:15:35.821 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-lenovo.ko 2024-01-24T15:15:35.822 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-24T15:15:35.822 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-24T15:15:35.822 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-multitouch.ko 2024-01-24T15:15:35.822 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-ortek.ko 2024-01-24T15:15:35.822 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-penmount.ko 2024-01-24T15:15:35.822 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-petalynx.ko 2024-01-24T15:15:35.822 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-picolcd.ko 2024-01-24T15:15:35.822 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-pl.ko 2024-01-24T15:15:35.822 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-plantronics.ko 2024-01-24T15:15:35.822 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-primax.ko 2024-01-24T15:15:35.822 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-rmi.ko 2024-01-24T15:15:35.822 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-24T15:15:35.822 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-common.ko 2024-01-24T15:15:35.822 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-24T15:15:35.822 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-24T15:15:35.822 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-24T15:15:35.823 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-24T15:15:35.823 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-24T15:15:35.823 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-24T15:15:35.823 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-24T15:15:35.823 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-24T15:15:35.823 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-24T15:15:35.823 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-roccat.ko 2024-01-24T15:15:35.823 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-saitek.ko 2024-01-24T15:15:35.823 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-samsung.ko 2024-01-24T15:15:35.823 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-24T15:15:35.823 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-sjoy.ko 2024-01-24T15:15:35.823 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-sony.ko 2024-01-24T15:15:35.823 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-speedlink.ko 2024-01-24T15:15:35.824 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-steelseries.ko 2024-01-24T15:15:35.824 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-sunplus.ko 2024-01-24T15:15:35.824 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-24T15:15:35.824 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-tivo.ko 2024-01-24T15:15:35.824 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-tmff.ko 2024-01-24T15:15:35.824 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-topseed.ko 2024-01-24T15:15:35.824 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-twinhan.ko 2024-01-24T15:15:35.824 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-uclogic.ko 2024-01-24T15:15:35.824 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-waltop.ko 2024-01-24T15:15:35.824 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-wiimote.ko 2024-01-24T15:15:35.824 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-xinmo.ko 2024-01-24T15:15:35.824 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-zpff.ko 2024-01-24T15:15:35.824 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/hid-zydacron.ko 2024-01-24T15:15:35.824 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/uhid.ko 2024-01-24T15:15:35.825 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hid/wacom.ko 2024-01-24T15:15:35.825 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hv 2024-01-24T15:15:35.825 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hv/hv_balloon.ko 2024-01-24T15:15:35.825 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hv/hv_utils.ko 2024-01-24T15:15:35.825 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hv/hv_vmbus.ko 2024-01-24T15:15:35.825 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon 2024-01-24T15:15:35.825 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/abituguru.ko 2024-01-24T15:15:35.825 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/abituguru3.ko 2024-01-24T15:15:35.825 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-24T15:15:35.825 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ad7414.ko 2024-01-24T15:15:35.825 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ad7418.ko 2024-01-24T15:15:35.825 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adc128d818.ko 2024-01-24T15:15:35.825 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm1025.ko 2024-01-24T15:15:35.825 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm1026.ko 2024-01-24T15:15:35.825 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm1029.ko 2024-01-24T15:15:35.826 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm1031.ko 2024-01-24T15:15:35.826 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adm9240.ko 2024-01-24T15:15:35.826 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ads7828.ko 2024-01-24T15:15:35.826 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7410.ko 2024-01-24T15:15:35.826 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7411.ko 2024-01-24T15:15:35.826 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7462.ko 2024-01-24T15:15:35.826 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7470.ko 2024-01-24T15:15:35.826 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7475.ko 2024-01-24T15:15:35.826 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/adt7x10.ko 2024-01-24T15:15:35.826 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/amc6821.ko 2024-01-24T15:15:35.826 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/applesmc.ko 2024-01-24T15:15:35.826 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/asb100.ko 2024-01-24T15:15:35.826 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/asc7621.ko 2024-01-24T15:15:35.826 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-24T15:15:35.827 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/atxp1.ko 2024-01-24T15:15:35.827 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/coretemp.ko 2024-01-24T15:15:35.827 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-24T15:15:35.827 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/dme1737.ko 2024-01-24T15:15:35.827 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ds1621.ko 2024-01-24T15:15:35.827 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ds620.ko 2024-01-24T15:15:35.827 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/emc1403.ko 2024-01-24T15:15:35.827 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/emc6w201.ko 2024-01-24T15:15:35.827 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/f71805f.ko 2024-01-24T15:15:35.827 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/f71882fg.ko 2024-01-24T15:15:35.827 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/f75375s.ko 2024-01-24T15:15:35.827 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/fam15h_power.ko 2024-01-24T15:15:35.827 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/fschmd.ko 2024-01-24T15:15:35.827 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/g760a.ko 2024-01-24T15:15:35.827 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/g762.ko 2024-01-24T15:15:35.828 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/gl518sm.ko 2024-01-24T15:15:35.828 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/gl520sm.ko 2024-01-24T15:15:35.828 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-24T15:15:35.828 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/i5500_temp.ko 2024-01-24T15:15:35.828 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/i5k_amb.ko 2024-01-24T15:15:35.828 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ibmaem.ko 2024-01-24T15:15:35.828 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ibmpex.ko 2024-01-24T15:15:35.828 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ina209.ko 2024-01-24T15:15:35.828 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ina2xx.ko 2024-01-24T15:15:35.828 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/it87.ko 2024-01-24T15:15:35.828 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/k10temp.ko 2024-01-24T15:15:35.828 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/k8temp.ko 2024-01-24T15:15:35.828 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lineage-pem.ko 2024-01-24T15:15:35.828 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm63.ko 2024-01-24T15:15:35.829 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm73.ko 2024-01-24T15:15:35.829 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm75.ko 2024-01-24T15:15:35.829 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm77.ko 2024-01-24T15:15:35.829 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm78.ko 2024-01-24T15:15:35.829 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm80.ko 2024-01-24T15:15:35.829 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm83.ko 2024-01-24T15:15:35.829 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm85.ko 2024-01-24T15:15:35.829 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm87.ko 2024-01-24T15:15:35.829 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm90.ko 2024-01-24T15:15:35.829 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm92.ko 2024-01-24T15:15:35.829 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm93.ko 2024-01-24T15:15:35.829 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm95234.ko 2024-01-24T15:15:35.829 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm95241.ko 2024-01-24T15:15:35.829 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/lm95245.ko 2024-01-24T15:15:35.830 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc2945.ko 2024-01-24T15:15:35.830 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4151.ko 2024-01-24T15:15:35.830 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4215.ko 2024-01-24T15:15:35.830 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4222.ko 2024-01-24T15:15:35.830 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4245.ko 2024-01-24T15:15:35.830 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4260.ko 2024-01-24T15:15:35.830 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/ltc4261.ko 2024-01-24T15:15:35.830 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max16065.ko 2024-01-24T15:15:35.830 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max1619.ko 2024-01-24T15:15:35.830 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max1668.ko 2024-01-24T15:15:35.830 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max197.ko 2024-01-24T15:15:35.830 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max6639.ko 2024-01-24T15:15:35.830 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max6650.ko 2024-01-24T15:15:35.831 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/max6697.ko 2024-01-24T15:15:35.831 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/mcp3021.ko 2024-01-24T15:15:35.831 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/nct6683.ko 2024-01-24T15:15:35.831 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/nct6775-core.ko 2024-01-24T15:15:35.831 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/nct6775.ko 2024-01-24T15:15:35.831 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/nct7802.ko 2024-01-24T15:15:35.831 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pc87360.ko 2024-01-24T15:15:35.831 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pc87427.ko 2024-01-24T15:15:35.831 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pcf8591.ko 2024-01-24T15:15:35.831 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus 2024-01-24T15:15:35.831 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-24T15:15:35.832 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-24T15:15:35.832 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-24T15:15:35.832 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-24T15:15:35.832 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-24T15:15:35.832 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-24T15:15:35.832 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-24T15:15:35.832 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-24T15:15:35.832 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-24T15:15:35.832 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-24T15:15:35.832 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-24T15:15:35.832 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-24T15:15:35.832 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/powr1220.ko 2024-01-24T15:15:35.833 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sch5627.ko 2024-01-24T15:15:35.833 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sch5636.ko 2024-01-24T15:15:35.833 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-24T15:15:35.833 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sht15.ko 2024-01-24T15:15:35.833 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sht21.ko 2024-01-24T15:15:35.833 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/shtc1.ko 2024-01-24T15:15:35.833 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/sis5595.ko 2024-01-24T15:15:35.833 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/smsc47b397.ko 2024-01-24T15:15:35.833 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/smsc47m1.ko 2024-01-24T15:15:35.833 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/smsc47m192.ko 2024-01-24T15:15:35.833 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/thmc50.ko 2024-01-24T15:15:35.834 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/tmp102.ko 2024-01-24T15:15:35.834 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/tmp103.ko 2024-01-24T15:15:35.834 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/tmp401.ko 2024-01-24T15:15:35.834 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/tmp421.ko 2024-01-24T15:15:35.834 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/via-cputemp.ko 2024-01-24T15:15:35.834 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/via686a.ko 2024-01-24T15:15:35.834 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/vt1211.ko 2024-01-24T15:15:35.834 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/vt8231.ko 2024-01-24T15:15:35.834 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83627ehf.ko 2024-01-24T15:15:35.834 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83627hf.ko 2024-01-24T15:15:35.834 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83781d.ko 2024-01-24T15:15:35.834 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83791d.ko 2024-01-24T15:15:35.834 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83792d.ko 2024-01-24T15:15:35.835 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83793.ko 2024-01-24T15:15:35.835 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83795.ko 2024-01-24T15:15:35.835 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83l785ts.ko 2024-01-24T15:15:35.835 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/hwmon/w83l786ng.ko 2024-01-24T15:15:35.835 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c 2024-01-24T15:15:35.835 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/algos 2024-01-24T15:15:35.835 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-24T15:15:35.835 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-24T15:15:35.835 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses 2024-01-24T15:15:35.835 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-24T15:15:35.835 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-24T15:15:35.835 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-24T15:15:35.835 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-24T15:15:35.836 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-24T15:15:35.836 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-24T15:15:35.836 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-24T15:15:35.836 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-24T15:15:35.836 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-24T15:15:35.836 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-24T15:15:35.836 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-24T15:15:35.836 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-24T15:15:35.836 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-24T15:15:35.836 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-24T15:15:35.836 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-24T15:15:35.836 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-24T15:15:35.837 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-24T15:15:35.837 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-24T15:15:35.837 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-24T15:15:35.837 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-24T15:15:35.837 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-24T15:15:35.837 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-24T15:15:35.837 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-24T15:15:35.837 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/i2c-dev.ko 2024-01-24T15:15:35.837 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/i2c-mux.ko 2024-01-24T15:15:35.837 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-01-24T15:15:35.837 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/i2c-smbus.ko 2024-01-24T15:15:35.837 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/i2c/i2c-stub.ko 2024-01-24T15:15:35.838 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband 2024-01-24T15:15:35.838 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core 2024-01-24T15:15:35.838 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-24T15:15:35.838 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ib_core.ko 2024-01-24T15:15:35.838 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-24T15:15:35.838 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-24T15:15:35.838 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-24T15:15:35.838 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-24T15:15:35.838 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-24T15:15:35.838 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw 2024-01-24T15:15:35.838 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/cxgb4 2024-01-24T15:15:35.839 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-24T15:15:35.839 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mlx4 2024-01-24T15:15:35.839 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-24T15:15:35.839 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mlx5 2024-01-24T15:15:35.839 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-24T15:15:35.839 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mthca 2024-01-24T15:15:35.839 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-24T15:15:35.839 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp 2024-01-24T15:15:35.839 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/ipoib 2024-01-24T15:15:35.839 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-24T15:15:35.839 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/iser 2024-01-24T15:15:35.839 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-24T15:15:35.839 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/isert 2024-01-24T15:15:35.840 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-24T15:15:35.840 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/srp 2024-01-24T15:15:35.840 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-24T15:15:35.840 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/srpt 2024-01-24T15:15:35.840 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-24T15:15:35.840 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input 2024-01-24T15:15:35.840 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/gameport 2024-01-24T15:15:35.840 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-24T15:15:35.840 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-24T15:15:35.840 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/gameport/gameport.ko 2024-01-24T15:15:35.840 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/joydev.ko 2024-01-24T15:15:35.840 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard 2024-01-24T15:15:35.840 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-24T15:15:35.841 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse 2024-01-24T15:15:35.841 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/appletouch.ko 2024-01-24T15:15:35.841 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/bcm5974.ko 2024-01-24T15:15:35.841 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/cyapatp.ko 2024-01-24T15:15:35.841 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-24T15:15:35.841 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/sermouse.ko 2024-01-24T15:15:35.841 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-24T15:15:35.841 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-24T15:15:35.841 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-24T15:15:35.841 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/rmi4 2024-01-24T15:15:35.841 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-24T15:15:35.841 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio 2024-01-24T15:15:35.841 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/altera_ps2.ko 2024-01-24T15:15:35.842 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/arc_ps2.ko 2024-01-24T15:15:35.842 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-24T15:15:35.842 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/serio/serio_raw.ko 2024-01-24T15:15:35.842 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/input/sparse-keymap.ko 2024-01-24T15:15:35.842 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds 2024-01-24T15:15:35.842 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-blinkm.ko 2024-01-24T15:15:35.842 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-lm3530.ko 2024-01-24T15:15:35.842 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-lp3944.ko 2024-01-24T15:15:35.842 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/leds-ss4200.ko 2024-01-24T15:15:35.842 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger 2024-01-24T15:15:35.842 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-24T15:15:35.842 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-24T15:15:35.842 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-24T15:15:35.842 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-24T15:15:35.843 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-01-24T15:15:35.843 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-24T15:15:35.843 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-24T15:15:35.843 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-24T15:15:35.843 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-24T15:15:35.843 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md 2024-01-24T15:15:35.843 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/bcache 2024-01-24T15:15:35.843 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/bcache/bcache.ko 2024-01-24T15:15:35.843 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-bio-prison.ko 2024-01-24T15:15:35.843 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-cache-smq.ko 2024-01-24T15:15:35.843 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-cache.ko 2024-01-24T15:15:35.843 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-crypt.ko 2024-01-24T15:15:35.843 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-delay.ko 2024-01-24T15:15:35.843 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-flakey.ko 2024-01-24T15:15:35.844 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-log-userspace.ko 2024-01-24T15:15:35.844 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-multipath.ko 2024-01-24T15:15:35.844 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-queue-length.ko 2024-01-24T15:15:35.844 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-raid.ko 2024-01-24T15:15:35.844 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-round-robin.ko 2024-01-24T15:15:35.844 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-service-time.ko 2024-01-24T15:15:35.844 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-switch.ko 2024-01-24T15:15:35.844 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-thin-pool.ko 2024-01-24T15:15:35.844 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/dm-verity.ko 2024-01-24T15:15:35.844 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/faulty.ko 2024-01-24T15:15:35.844 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/linear.ko 2024-01-24T15:15:35.844 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/multipath.ko 2024-01-24T15:15:35.844 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/persistent-data 2024-01-24T15:15:35.844 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-24T15:15:35.844 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/raid0.ko 2024-01-24T15:15:35.845 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/raid1.ko 2024-01-24T15:15:35.845 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/raid10.ko 2024-01-24T15:15:35.845 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/md/raid456.ko 2024-01-24T15:15:35.845 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message 2024-01-24T15:15:35.845 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion 2024-01-24T15:15:35.845 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptbase.ko 2024-01-24T15:15:35.845 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptctl.ko 2024-01-24T15:15:35.845 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptfc.ko 2024-01-24T15:15:35.845 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptlan.ko 2024-01-24T15:15:35.845 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptsas.ko 2024-01-24T15:15:35.845 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptscsih.ko 2024-01-24T15:15:35.845 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/message/fusion/mptspi.ko 2024-01-24T15:15:35.845 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd 2024-01-24T15:15:35.845 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/lpc_ich.ko 2024-01-24T15:15:35.846 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/lpc_sch.ko 2024-01-24T15:15:35.846 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/mfd-core.ko 2024-01-24T15:15:35.846 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/sm501.ko 2024-01-24T15:15:35.846 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/viperboard.ko 2024-01-24T15:15:35.846 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/vx855.ko 2024-01-24T15:15:35.846 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/mfd/wl1273-core.ko 2024-01-24T15:15:35.846 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc 2024-01-24T15:15:35.846 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/altera-stapl 2024-01-24T15:15:35.846 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-24T15:15:35.846 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/apds9802als.ko 2024-01-24T15:15:35.846 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/apds990x.ko 2024-01-24T15:15:35.846 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/bh1770glc.ko 2024-01-24T15:15:35.846 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/cb710 2024-01-24T15:15:35.846 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/cb710/cb710.ko 2024-01-24T15:15:35.847 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/eeprom 2024-01-24T15:15:35.847 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/eeprom/at24.ko 2024-01-24T15:15:35.847 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-24T15:15:35.847 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/eeprom/max6875.ko 2024-01-24T15:15:35.847 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/enclosure.ko 2024-01-24T15:15:35.847 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/hpilo.ko 2024-01-24T15:15:35.847 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/isl29003.ko 2024-01-24T15:15:35.847 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/isl29020.ko 2024-01-24T15:15:35.847 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/lis3lv02d 2024-01-24T15:15:35.847 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-24T15:15:35.847 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-24T15:15:35.847 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/mei 2024-01-24T15:15:35.847 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/mei/mei-me.ko 2024-01-24T15:15:35.847 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/mei/mei-txe.ko 2024-01-24T15:15:35.847 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/mei/mei.ko 2024-01-24T15:15:35.848 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/sgi-gru 2024-01-24T15:15:35.848 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/sgi-gru/gru.ko 2024-01-24T15:15:35.848 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/sgi-xp 2024-01-24T15:15:35.848 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/sgi-xp/xp.ko 2024-01-24T15:15:35.848 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/sgi-xp/xpc.ko 2024-01-24T15:15:35.848 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-01-24T15:15:35.848 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/tifm_7xx1.ko 2024-01-24T15:15:35.848 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/tifm_core.ko 2024-01-24T15:15:35.848 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/tsl2550.ko 2024-01-24T15:15:35.848 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/vmw_balloon.ko 2024-01-24T15:15:35.848 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/vmw_vmci 2024-01-24T15:15:35.848 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-24T15:15:35.848 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net 2024-01-24T15:15:35.848 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/bonding 2024-01-24T15:15:35.849 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/bonding/bonding.ko 2024-01-24T15:15:35.849 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa 2024-01-24T15:15:35.849 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/b53 2024-01-24T15:15:35.849 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-24T15:15:35.849 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-24T15:15:35.849 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-24T15:15:35.849 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/mv88e6xxx 2024-01-24T15:15:35.849 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-24T15:15:35.849 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/dummy.ko 2024-01-24T15:15:35.849 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/eql.ko 2024-01-24T15:15:35.849 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet 2024-01-24T15:15:35.849 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com 2024-01-24T15:15:35.849 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-24T15:15:35.850 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-24T15:15:35.850 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-24T15:15:35.850 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-24T15:15:35.850 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390 2024-01-24T15:15:35.850 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-24T15:15:35.850 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-24T15:15:35.850 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-24T15:15:35.850 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-24T15:15:35.850 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/adaptec 2024-01-24T15:15:35.850 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-24T15:15:35.850 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/agere 2024-01-24T15:15:35.850 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-24T15:15:35.850 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/alteon 2024-01-24T15:15:35.850 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-24T15:15:35.850 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/altera 2024-01-24T15:15:35.851 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-24T15:15:35.851 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/amd 2024-01-24T15:15:35.851 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-24T15:15:35.851 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-24T15:15:35.851 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-24T15:15:35.851 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros 2024-01-24T15:15:35.851 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/alx 2024-01-24T15:15:35.851 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-24T15:15:35.851 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atl1c 2024-01-24T15:15:35.851 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-24T15:15:35.851 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atl1e 2024-01-24T15:15:35.851 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-24T15:15:35.851 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atlx 2024-01-24T15:15:35.852 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-24T15:15:35.852 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-24T15:15:35.852 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom 2024-01-24T15:15:35.852 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-24T15:15:35.852 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-24T15:15:35.852 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-01-24T15:15:35.852 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-24T15:15:35.852 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-24T15:15:35.852 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/genet 2024-01-24T15:15:35.852 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-24T15:15:35.853 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-24T15:15:35.853 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/brocade 2024-01-24T15:15:35.853 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/brocade/bna 2024-01-24T15:15:35.853 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-24T15:15:35.853 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio 2024-01-24T15:15:35.853 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb 2024-01-24T15:15:35.853 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-24T15:15:35.853 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-01-24T15:15:35.853 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-24T15:15:35.853 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-01-24T15:15:35.853 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-24T15:15:35.854 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-01-24T15:15:35.854 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-24T15:15:35.854 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-01-24T15:15:35.854 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-24T15:15:35.854 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/cisco 2024-01-24T15:15:35.854 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/cisco/enic 2024-01-24T15:15:35.854 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-24T15:15:35.854 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec 2024-01-24T15:15:35.854 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip 2024-01-24T15:15:35.854 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-24T15:15:35.854 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-24T15:15:35.855 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-24T15:15:35.855 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-24T15:15:35.855 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-24T15:15:35.855 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-24T15:15:35.855 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dlink 2024-01-24T15:15:35.855 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-24T15:15:35.855 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-24T15:15:35.855 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/dnet.ko 2024-01-24T15:15:35.855 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/emulex 2024-01-24T15:15:35.855 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/emulex/benet 2024-01-24T15:15:35.855 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-24T15:15:35.856 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/ethoc.ko 2024-01-24T15:15:35.856 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/fealnx.ko 2024-01-24T15:15:35.856 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel 2024-01-24T15:15:35.856 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-24T15:15:35.856 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e1000 2024-01-24T15:15:35.856 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-24T15:15:35.856 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e1000e 2024-01-24T15:15:35.856 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-24T15:15:35.856 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/fm10k 2024-01-24T15:15:35.856 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-24T15:15:35.857 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/i40e 2024-01-24T15:15:35.857 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-24T15:15:35.857 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/iavf 2024-01-24T15:15:35.857 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-24T15:15:35.857 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/igb 2024-01-24T15:15:35.857 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-24T15:15:35.857 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/igbvf 2024-01-24T15:15:35.857 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-24T15:15:35.857 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ixgbe 2024-01-24T15:15:35.857 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-24T15:15:35.857 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ixgbevf 2024-01-24T15:15:35.858 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-24T15:15:35.858 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/jme.ko 2024-01-24T15:15:35.858 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/marvell 2024-01-24T15:15:35.858 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-24T15:15:35.858 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-24T15:15:35.858 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-24T15:15:35.858 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox 2024-01-24T15:15:35.858 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx4 2024-01-24T15:15:35.858 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-24T15:15:35.858 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-24T15:15:35.859 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx5 2024-01-24T15:15:35.859 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-01-24T15:15:35.859 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-24T15:15:35.859 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/micrel 2024-01-24T15:15:35.859 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-24T15:15:35.859 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/myricom 2024-01-24T15:15:35.859 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/myricom/myri10ge 2024-01-24T15:15:35.859 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-24T15:15:35.859 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/natsemi 2024-01-24T15:15:35.859 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-24T15:15:35.860 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-24T15:15:35.860 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/neterion 2024-01-24T15:15:35.860 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-24T15:15:35.860 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/nvidia 2024-01-24T15:15:35.860 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-24T15:15:35.860 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/packetengines 2024-01-24T15:15:35.860 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-24T15:15:35.860 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-24T15:15:35.860 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic 2024-01-24T15:15:35.860 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/netxen 2024-01-24T15:15:35.860 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-24T15:15:35.860 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-24T15:15:35.860 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-01-24T15:15:35.861 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-24T15:15:35.861 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/rdc 2024-01-24T15:15:35.861 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-24T15:15:35.861 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek 2024-01-24T15:15:35.861 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-24T15:15:35.861 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-24T15:15:35.861 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-24T15:15:35.861 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-24T15:15:35.861 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/rocker 2024-01-24T15:15:35.861 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-01-24T15:15:35.861 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sfc 2024-01-24T15:15:35.861 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-24T15:15:35.861 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/silan 2024-01-24T15:15:35.861 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-24T15:15:35.862 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sis 2024-01-24T15:15:35.862 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-24T15:15:35.862 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-24T15:15:35.862 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc 2024-01-24T15:15:35.862 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-24T15:15:35.862 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-24T15:15:35.862 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-24T15:15:35.862 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-24T15:15:35.862 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro 2024-01-24T15:15:35.862 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/stmmac 2024-01-24T15:15:35.862 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-24T15:15:35.862 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-24T15:15:35.862 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun 2024-01-24T15:15:35.862 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-24T15:15:35.862 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-24T15:15:35.863 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-24T15:15:35.863 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-24T15:15:35.863 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/tehuti 2024-01-24T15:15:35.863 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-24T15:15:35.863 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/ti 2024-01-24T15:15:35.863 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-24T15:15:35.863 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/via 2024-01-24T15:15:35.863 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-24T15:15:35.863 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-24T15:15:35.863 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/wiznet 2024-01-24T15:15:35.863 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-24T15:15:35.863 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-24T15:15:35.863 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/xircom 2024-01-24T15:15:35.863 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-24T15:15:35.864 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/geneve.ko 2024-01-24T15:15:35.864 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/hyperv 2024-01-24T15:15:35.864 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-24T15:15:35.864 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ieee802154 2024-01-24T15:15:35.864 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-24T15:15:35.864 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ifb.ko 2024-01-24T15:15:35.864 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ipvlan 2024-01-24T15:15:35.864 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-24T15:15:35.864 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/macvlan.ko 2024-01-24T15:15:35.864 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/macvtap.ko 2024-01-24T15:15:35.864 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio 2024-01-24T15:15:35.864 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio.ko 2024-01-24T15:15:35.864 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-24T15:15:35.864 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-24T15:15:35.864 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-24T15:15:35.865 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/mii.ko 2024-01-24T15:15:35.865 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/net_failover.ko 2024-01-24T15:15:35.865 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/netconsole.ko 2024-01-24T15:15:35.865 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/nlmon.ko 2024-01-24T15:15:35.865 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/pcs 2024-01-24T15:15:35.865 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-24T15:15:35.865 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-24T15:15:35.865 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy 2024-01-24T15:15:35.865 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/amd.ko 2024-01-24T15:15:35.865 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-24T15:15:35.865 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-01-24T15:15:35.865 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-24T15:15:35.865 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/bcm87xx.ko 2024-01-24T15:15:35.865 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/broadcom.ko 2024-01-24T15:15:35.866 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/cicada.ko 2024-01-24T15:15:35.866 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/davicom.ko 2024-01-24T15:15:35.866 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/dp83640.ko 2024-01-24T15:15:35.866 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/et1011c.ko 2024-01-24T15:15:35.866 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/icplus.ko 2024-01-24T15:15:35.866 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/lxt.ko 2024-01-24T15:15:35.866 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/marvell.ko 2024-01-24T15:15:35.866 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/micrel.ko 2024-01-24T15:15:35.866 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/national.ko 2024-01-24T15:15:35.866 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/phylink.ko 2024-01-24T15:15:35.866 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/qsemi.ko 2024-01-24T15:15:35.866 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/realtek.ko 2024-01-24T15:15:35.866 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/smsc.ko 2024-01-24T15:15:35.866 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/ste10Xp.ko 2024-01-24T15:15:35.867 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/phy/vitesse.ko 2024-01-24T15:15:35.867 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp 2024-01-24T15:15:35.867 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-24T15:15:35.867 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_async.ko 2024-01-24T15:15:35.867 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-24T15:15:35.867 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_generic.ko 2024-01-24T15:15:35.867 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-24T15:15:35.867 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-24T15:15:35.867 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/pppoe.ko 2024-01-24T15:15:35.867 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/pppox.ko 2024-01-24T15:15:35.867 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/ppp/pptp.ko 2024-01-24T15:15:35.867 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/slip 2024-01-24T15:15:35.867 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/slip/slhc.ko 2024-01-24T15:15:35.867 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/slip/slip.ko 2024-01-24T15:15:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/sungem_phy.ko 2024-01-24T15:15:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/tap.ko 2024-01-24T15:15:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team 2024-01-24T15:15:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team.ko 2024-01-24T15:15:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-24T15:15:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-24T15:15:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-24T15:15:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_random.ko 2024-01-24T15:15:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-24T15:15:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/tun.ko 2024-01-24T15:15:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/veth.ko 2024-01-24T15:15:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/virtio_net.ko 2024-01-24T15:15:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/vmxnet3 2024-01-24T15:15:35.868 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-24T15:15:35.869 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/vxlan 2024-01-24T15:15:35.869 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/vxlan/vxlan.ko 2024-01-24T15:15:35.869 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/xen-netback 2024-01-24T15:15:35.869 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-24T15:15:35.869 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/net/xen-netfront.ko 2024-01-24T15:15:35.869 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ntb 2024-01-24T15:15:35.869 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ntb/ntb.ko 2024-01-24T15:15:35.869 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/nvme 2024-01-24T15:15:35.869 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/nvme/host 2024-01-24T15:15:35.869 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/nvme/host/nvme-core.ko 2024-01-24T15:15:35.869 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/nvme/host/nvme.ko 2024-01-24T15:15:35.869 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport 2024-01-24T15:15:35.869 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/parport.ko 2024-01-24T15:15:35.869 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/parport_cs.ko 2024-01-24T15:15:35.869 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/parport_pc.ko 2024-01-24T15:15:35.870 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/parport/parport_serial.ko 2024-01-24T15:15:35.870 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci 2024-01-24T15:15:35.870 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/hotplug 2024-01-24T15:15:35.870 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-24T15:15:35.870 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/pcie 2024-01-24T15:15:35.870 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/pcie/aer_inject.ko 2024-01-24T15:15:35.870 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pci/xen-pcifront.ko 2024-01-24T15:15:35.870 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia 2024-01-24T15:15:35.870 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/i82092.ko 2024-01-24T15:15:35.870 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/pd6729.ko 2024-01-24T15:15:35.870 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-24T15:15:35.870 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pinctrl 2024-01-24T15:15:35.870 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pinctrl/intel 2024-01-24T15:15:35.870 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-24T15:15:35.870 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform 2024-01-24T15:15:35.871 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86 2024-01-24T15:15:35.871 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-24T15:15:35.871 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/acerhdf.ko 2024-01-24T15:15:35.871 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-24T15:15:35.871 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-24T15:15:35.871 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-24T15:15:35.871 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-24T15:15:35.871 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-24T15:15:35.871 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-24T15:15:35.871 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-24T15:15:35.871 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-24T15:15:35.871 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-24T15:15:35.871 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/hdaps.ko 2024-01-24T15:15:35.871 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/intel 2024-01-24T15:15:35.871 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-24T15:15:35.872 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/intel_ips.ko 2024-01-24T15:15:35.872 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-24T15:15:35.872 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-24T15:15:35.872 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-24T15:15:35.872 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-24T15:15:35.872 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-24T15:15:35.872 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-24T15:15:35.872 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-24T15:15:35.872 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-24T15:15:35.872 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-24T15:15:35.872 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/platform/x86/wmi.ko 2024-01-24T15:15:35.872 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/powercap 2024-01-24T15:15:35.872 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-24T15:15:35.872 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-24T15:15:35.872 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps 2024-01-24T15:15:35.873 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/clients 2024-01-24T15:15:35.873 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-24T15:15:35.873 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-24T15:15:35.873 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/clients/pps_parport.ko 2024-01-24T15:15:35.873 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/pps/pps_core.ko 2024-01-24T15:15:35.873 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ptp 2024-01-24T15:15:35.873 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ptp/ptp.ko 2024-01-24T15:15:35.873 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ptp/ptp_kvm.ko 2024-01-24T15:15:35.873 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc 2024-01-24T15:15:35.873 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-24T15:15:35.873 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-24T15:15:35.873 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-24T15:15:35.873 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-24T15:15:35.873 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-24T15:15:35.874 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-24T15:15:35.874 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-24T15:15:35.874 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-24T15:15:35.874 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-24T15:15:35.874 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-24T15:15:35.874 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-em3027.ko 2024-01-24T15:15:35.874 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-24T15:15:35.874 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-24T15:15:35.874 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-24T15:15:35.874 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-24T15:15:35.874 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-24T15:15:35.874 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-24T15:15:35.874 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-max6900.ko 2024-01-24T15:15:35.874 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-24T15:15:35.874 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-24T15:15:35.875 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-24T15:15:35.875 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-24T15:15:35.875 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-24T15:15:35.875 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-24T15:15:35.875 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-24T15:15:35.875 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-24T15:15:35.875 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-24T15:15:35.875 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-24T15:15:35.875 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-24T15:15:35.875 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-24T15:15:35.875 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/rtc/rtc-x1205.ko 2024-01-24T15:15:35.875 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi 2024-01-24T15:15:35.875 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/3w-9xxx.ko 2024-01-24T15:15:35.875 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/3w-sas.ko 2024-01-24T15:15:35.875 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/3w-xxxx.ko 2024-01-24T15:15:35.876 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/BusLogic.ko 2024-01-24T15:15:35.876 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/a100u2w.ko 2024-01-24T15:15:35.876 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aacraid 2024-01-24T15:15:35.876 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-24T15:15:35.876 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/advansys.ko 2024-01-24T15:15:35.876 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aic7xxx 2024-01-24T15:15:35.876 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-24T15:15:35.876 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-24T15:15:35.876 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/am53c974.ko 2024-01-24T15:15:35.876 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/arcmsr 2024-01-24T15:15:35.876 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-24T15:15:35.876 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/atp870u.ko 2024-01-24T15:15:35.876 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/be2iscsi 2024-01-24T15:15:35.876 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-24T15:15:35.877 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bfa 2024-01-24T15:15:35.877 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bfa/bfa.ko 2024-01-24T15:15:35.877 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bnx2fc 2024-01-24T15:15:35.877 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-24T15:15:35.877 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bnx2i 2024-01-24T15:15:35.877 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-24T15:15:35.877 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ch.ko 2024-01-24T15:15:35.877 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/csiostor 2024-01-24T15:15:35.877 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-24T15:15:35.877 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi 2024-01-24T15:15:35.877 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/cxgb3i 2024-01-24T15:15:35.877 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-24T15:15:35.877 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/cxgb4i 2024-01-24T15:15:35.878 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-24T15:15:35.878 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-24T15:15:35.878 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/dc395x.ko 2024-01-24T15:15:35.878 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/device_handler 2024-01-24T15:15:35.878 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-01-24T15:15:35.878 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-01-24T15:15:35.878 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-01-24T15:15:35.878 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-01-24T15:15:35.878 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/dmx3191d.ko 2024-01-24T15:15:35.878 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/esas2r 2024-01-24T15:15:35.878 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-24T15:15:35.878 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/esp_scsi.ko 2024-01-24T15:15:35.878 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fcoe 2024-01-24T15:15:35.878 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-24T15:15:35.879 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-24T15:15:35.879 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fnic 2024-01-24T15:15:35.879 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/fnic/fnic.ko 2024-01-24T15:15:35.879 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/hpsa.ko 2024-01-24T15:15:35.879 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/hptiop.ko 2024-01-24T15:15:35.879 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/hv_storvsc.ko 2024-01-24T15:15:35.879 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/initio.ko 2024-01-24T15:15:35.879 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ipr.ko 2024-01-24T15:15:35.879 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ips.ko 2024-01-24T15:15:35.879 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/isci 2024-01-24T15:15:35.879 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/isci/isci.ko 2024-01-24T15:15:35.879 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-24T15:15:35.879 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-24T15:15:35.879 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libfc 2024-01-24T15:15:35.879 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libfc/libfc.ko 2024-01-24T15:15:35.879 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libiscsi.ko 2024-01-24T15:15:35.880 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-24T15:15:35.880 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libsas 2024-01-24T15:15:35.880 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/libsas/libsas.ko 2024-01-24T15:15:35.880 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/lpfc 2024-01-24T15:15:35.880 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-24T15:15:35.880 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid 2024-01-24T15:15:35.880 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid.ko 2024-01-24T15:15:35.880 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-24T15:15:35.880 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-24T15:15:35.880 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-24T15:15:35.880 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mpt3sas 2024-01-24T15:15:35.880 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-24T15:15:35.880 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mvsas 2024-01-24T15:15:35.880 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-24T15:15:35.880 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/mvumi.ko 2024-01-24T15:15:35.880 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pm8001 2024-01-24T15:15:35.881 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-24T15:15:35.881 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/pmcraid.ko 2024-01-24T15:15:35.881 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla1280.ko 2024-01-24T15:15:35.881 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla2xxx 2024-01-24T15:15:35.881 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-24T15:15:35.881 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-24T15:15:35.881 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla4xxx 2024-01-24T15:15:35.881 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-24T15:15:35.881 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/raid_class.ko 2024-01-24T15:15:35.881 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_debug.ko 2024-01-24T15:15:35.881 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-24T15:15:35.881 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-24T15:15:35.881 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-24T15:15:35.882 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-24T15:15:35.882 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-24T15:15:35.882 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/ses.ko 2024-01-24T15:15:35.882 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/st.ko 2024-01-24T15:15:35.882 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/stex.ko 2024-01-24T15:15:35.882 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/sym53c8xx_2 2024-01-24T15:15:35.882 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-24T15:15:35.882 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/virtio_scsi.ko 2024-01-24T15:15:35.882 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-24T15:15:35.882 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/scsi/wd719x.ko 2024-01-24T15:15:35.882 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ssb 2024-01-24T15:15:35.882 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ssb/ssb.ko 2024-01-24T15:15:35.882 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target 2024-01-24T15:15:35.882 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/iscsi 2024-01-24T15:15:35.883 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-24T15:15:35.883 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/loopback 2024-01-24T15:15:35.883 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-24T15:15:35.883 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_file.ko 2024-01-24T15:15:35.883 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_iblock.ko 2024-01-24T15:15:35.883 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_mod.ko 2024-01-24T15:15:35.883 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_pscsi.ko 2024-01-24T15:15:35.883 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/target_core_user.ko 2024-01-24T15:15:35.883 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/tcm_fc 2024-01-24T15:15:35.883 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-24T15:15:35.883 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal 2024-01-24T15:15:35.883 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel 2024-01-24T15:15:35.883 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal 2024-01-24T15:15:35.883 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-24T15:15:35.884 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-24T15:15:35.884 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-24T15:15:35.884 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-24T15:15:35.884 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-24T15:15:35.884 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-24T15:15:35.884 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-24T15:15:35.884 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-24T15:15:35.884 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-24T15:15:35.884 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-24T15:15:35.884 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-01-24T15:15:35.884 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-24T15:15:35.884 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-24T15:15:35.884 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-01-24T15:15:35.885 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-01-24T15:15:35.885 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-24T15:15:35.885 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-24T15:15:35.885 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-24T15:15:35.885 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty 2024-01-24T15:15:35.885 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/ipwireless 2024-01-24T15:15:35.885 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-24T15:15:35.885 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/n_gsm.ko 2024-01-24T15:15:35.885 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/n_hdlc.ko 2024-01-24T15:15:35.885 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/nozomi.ko 2024-01-24T15:15:35.885 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial 2024-01-24T15:15:35.885 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/8250 2024-01-24T15:15:35.885 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-24T15:15:35.885 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/arc_uart.ko 2024-01-24T15:15:35.886 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/jsm 2024-01-24T15:15:35.886 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-24T15:15:35.886 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs 2024-01-24T15:15:35.886 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/core 2024-01-24T15:15:35.886 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-24T15:15:35.886 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/host 2024-01-24T15:15:35.886 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-24T15:15:35.886 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio 2024-01-24T15:15:35.886 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio.ko 2024-01-24T15:15:35.886 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_aec.ko 2024-01-24T15:15:35.886 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_cif.ko 2024-01-24T15:15:35.886 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_pci_generic.ko 2024-01-24T15:15:35.886 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/uio/uio_sercos3.ko 2024-01-24T15:15:35.886 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb 2024-01-24T15:15:35.887 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class 2024-01-24T15:15:35.887 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/cdc-acm.ko 2024-01-24T15:15:35.887 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-24T15:15:35.887 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/usblp.ko 2024-01-24T15:15:35.887 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/class/usbtmc.ko 2024-01-24T15:15:35.887 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host 2024-01-24T15:15:35.887 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-24T15:15:35.887 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/image 2024-01-24T15:15:35.887 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/image/mdc800.ko 2024-01-24T15:15:35.887 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/image/microtek.ko 2024-01-24T15:15:35.887 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc 2024-01-24T15:15:35.887 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/adutux.ko 2024-01-24T15:15:35.887 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/appledisplay.ko 2024-01-24T15:15:35.887 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/emi26.ko 2024-01-24T15:15:35.887 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/emi62.ko 2024-01-24T15:15:35.888 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/ezusb.ko 2024-01-24T15:15:35.888 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/idmouse.ko 2024-01-24T15:15:35.888 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/iowarrior.ko 2024-01-24T15:15:35.888 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-24T15:15:35.888 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/ldusb.ko 2024-01-24T15:15:35.888 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/legousbtower.ko 2024-01-24T15:15:35.888 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/sisusbvga 2024-01-24T15:15:35.888 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-24T15:15:35.888 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-24T15:15:35.888 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/usb3503.ko 2024-01-24T15:15:35.888 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/usblcd.ko 2024-01-24T15:15:35.888 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-24T15:15:35.888 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/uss720.ko 2024-01-24T15:15:35.888 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/misc/yurex.ko 2024-01-24T15:15:35.888 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/phy 2024-01-24T15:15:35.889 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/phy/phy-generic.ko 2024-01-24T15:15:35.889 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial 2024-01-24T15:15:35.889 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/aircable.ko 2024-01-24T15:15:35.889 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ark3116.ko 2024-01-24T15:15:35.889 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-24T15:15:35.889 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ch341.ko 2024-01-24T15:15:35.889 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/cp210x.ko 2024-01-24T15:15:35.889 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/cyberjack.ko 2024-01-24T15:15:35.889 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-24T15:15:35.889 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-24T15:15:35.889 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/empeg.ko 2024-01-24T15:15:35.889 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-24T15:15:35.889 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-24T15:15:35.890 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-24T15:15:35.890 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/io_ti.ko 2024-01-24T15:15:35.890 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ipaq.ko 2024-01-24T15:15:35.890 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ipw.ko 2024-01-24T15:15:35.890 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ir-usb.ko 2024-01-24T15:15:35.890 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-24T15:15:35.890 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/keyspan.ko 2024-01-24T15:15:35.890 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-24T15:15:35.890 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-24T15:15:35.890 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-24T15:15:35.890 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/mct_u232.ko 2024-01-24T15:15:35.890 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/mos7720.ko 2024-01-24T15:15:35.890 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/mos7840.ko 2024-01-24T15:15:35.890 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/navman.ko 2024-01-24T15:15:35.890 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/omninet.ko 2024-01-24T15:15:35.891 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/opticon.ko 2024-01-24T15:15:35.891 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/option.ko 2024-01-24T15:15:35.891 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/oti6858.ko 2024-01-24T15:15:35.891 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/pl2303.ko 2024-01-24T15:15:35.891 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/qcaux.ko 2024-01-24T15:15:35.891 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/qcserial.ko 2024-01-24T15:15:35.891 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/quatech2.ko 2024-01-24T15:15:35.891 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/safe_serial.ko 2024-01-24T15:15:35.891 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/sierra.ko 2024-01-24T15:15:35.891 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-24T15:15:35.891 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ssu100.ko 2024-01-24T15:15:35.891 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/symbolserial.ko 2024-01-24T15:15:35.891 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-24T15:15:35.891 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-24T15:15:35.891 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/usb_debug.ko 2024-01-24T15:15:35.891 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-24T15:15:35.892 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/visor.ko 2024-01-24T15:15:35.892 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/whiteheat.ko 2024-01-24T15:15:35.892 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-24T15:15:35.892 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage 2024-01-24T15:15:35.892 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/uas.ko 2024-01-24T15:15:35.892 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-24T15:15:35.892 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-24T15:15:35.892 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-24T15:15:35.892 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-24T15:15:35.892 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-24T15:15:35.892 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-24T15:15:35.892 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-24T15:15:35.892 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-karma.ko 2024-01-24T15:15:35.893 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-24T15:15:35.893 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-24T15:15:35.893 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-24T15:15:35.893 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-24T15:15:35.893 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-24T15:15:35.893 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/storage/usb-storage.ko 2024-01-24T15:15:35.893 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/usbip 2024-01-24T15:15:35.893 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-24T15:15:35.893 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-24T15:15:35.893 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-24T15:15:35.893 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio 2024-01-24T15:15:35.893 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/pci 2024-01-24T15:15:35.893 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-24T15:15:35.893 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-24T15:15:35.894 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/vfio.ko 2024-01-24T15:15:35.894 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-24T15:15:35.894 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost 2024-01-24T15:15:35.894 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/vhost.ko 2024-01-24T15:15:35.894 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-24T15:15:35.894 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/vhost_net.ko 2024-01-24T15:15:35.894 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/vhost/vhost_scsi.ko 2024-01-24T15:15:35.894 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/video 2024-01-24T15:15:35.894 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight 2024-01-24T15:15:35.894 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/apple_bl.ko 2024-01-24T15:15:35.894 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/lcd.ko 2024-01-24T15:15:35.894 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-24T15:15:35.894 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/virtio 2024-01-24T15:15:35.894 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/virtio/virtio.ko 2024-01-24T15:15:35.895 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/virtio/virtio_balloon.ko 2024-01-24T15:15:35.895 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/virtio/virtio_mmio.ko 2024-01-24T15:15:35.895 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/virtio/virtio_pci.ko 2024-01-24T15:15:35.895 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-01-24T15:15:35.895 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-01-24T15:15:35.895 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/virtio/virtio_ring.ko 2024-01-24T15:15:35.895 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1 2024-01-24T15:15:35.895 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/masters 2024-01-24T15:15:35.895 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/masters/ds2482.ko 2024-01-24T15:15:35.895 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/masters/ds2490.ko 2024-01-24T15:15:35.895 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves 2024-01-24T15:15:35.895 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-24T15:15:35.895 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-24T15:15:35.896 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-24T15:15:35.896 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-24T15:15:35.896 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-24T15:15:35.896 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-24T15:15:35.896 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-24T15:15:35.896 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-24T15:15:35.896 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-24T15:15:35.896 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-24T15:15:35.896 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-24T15:15:35.896 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/w1/wire.ko 2024-01-24T15:15:35.896 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog 2024-01-24T15:15:35.896 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-24T15:15:35.896 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-24T15:15:35.897 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-24T15:15:35.897 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/hpwdt.ko 2024-01-24T15:15:35.897 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/i6300esb.ko 2024-01-24T15:15:35.897 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-24T15:15:35.897 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-24T15:15:35.897 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/ib700wdt.ko 2024-01-24T15:15:35.897 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/ibmasr.ko 2024-01-24T15:15:35.897 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-24T15:15:35.897 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-24T15:15:35.897 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/it87_wdt.ko 2024-01-24T15:15:35.897 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/machzwd.ko 2024-01-24T15:15:35.897 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/nv_tco.ko 2024-01-24T15:15:35.897 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-24T15:15:35.898 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-24T15:15:35.898 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-24T15:15:35.898 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-24T15:15:35.898 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/softdog.ko 2024-01-24T15:15:35.898 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-24T15:15:35.898 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/via_wdt.ko 2024-01-24T15:15:35.898 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-24T15:15:35.898 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-24T15:15:35.898 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-24T15:15:35.898 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/wdt_pci.ko 2024-01-24T15:15:35.898 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/watchdog/xen_wdt.ko 2024-01-24T15:15:35.898 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen 2024-01-24T15:15:35.898 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-acpi-processor.ko 2024-01-24T15:15:35.899 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-evtchn.ko 2024-01-24T15:15:35.899 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-gntalloc.ko 2024-01-24T15:15:35.899 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-gntdev.ko 2024-01-24T15:15:35.899 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-pciback 2024-01-24T15:15:35.899 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-24T15:15:35.899 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xen-privcmd.ko 2024-01-24T15:15:35.899 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xenfs 2024-01-24T15:15:35.899 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-24T15:15:35.899 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs 2024-01-24T15:15:35.899 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/9p 2024-01-24T15:15:35.899 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/9p/9p.ko 2024-01-24T15:15:35.899 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/affs 2024-01-24T15:15:35.899 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/affs/affs.ko 2024-01-24T15:15:35.900 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/befs 2024-01-24T15:15:35.900 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/befs/befs.ko 2024-01-24T15:15:35.900 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/binfmt_misc.ko 2024-01-24T15:15:35.900 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/btrfs 2024-01-24T15:15:35.900 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/btrfs/btrfs.ko 2024-01-24T15:15:35.900 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/cachefiles 2024-01-24T15:15:35.900 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/cachefiles/cachefiles.ko 2024-01-24T15:15:35.900 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ceph 2024-01-24T15:15:35.900 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ceph/ceph.ko 2024-01-24T15:15:35.900 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/coda 2024-01-24T15:15:35.900 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/coda/coda.ko 2024-01-24T15:15:35.900 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/cramfs 2024-01-24T15:15:35.901 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/cramfs/cramfs.ko 2024-01-24T15:15:35.901 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/dlm 2024-01-24T15:15:35.901 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/dlm/dlm.ko 2024-01-24T15:15:35.901 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ecryptfs 2024-01-24T15:15:35.901 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ecryptfs/ecryptfs.ko 2024-01-24T15:15:35.901 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/f2fs 2024-01-24T15:15:35.901 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/f2fs/f2fs.ko 2024-01-24T15:15:35.901 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fat 2024-01-24T15:15:35.901 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fat/fat.ko 2024-01-24T15:15:35.901 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fat/msdos.ko 2024-01-24T15:15:35.901 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fat/vfat.ko 2024-01-24T15:15:35.902 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fscache 2024-01-24T15:15:35.902 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fscache/fscache.ko 2024-01-24T15:15:35.902 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fuse 2024-01-24T15:15:35.902 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fuse/cuse.ko 2024-01-24T15:15:35.902 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/fuse/fuse.ko 2024-01-24T15:15:35.902 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/gfs2 2024-01-24T15:15:35.902 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/gfs2/gfs2.ko 2024-01-24T15:15:35.902 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/hfs 2024-01-24T15:15:35.902 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/hfs/hfs.ko 2024-01-24T15:15:35.902 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/hfsplus 2024-01-24T15:15:35.902 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/hfsplus/hfsplus.ko 2024-01-24T15:15:35.903 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/isofs 2024-01-24T15:15:35.903 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/isofs/isofs.ko 2024-01-24T15:15:35.903 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/jfs 2024-01-24T15:15:35.903 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/jfs/jfs.ko 2024-01-24T15:15:35.903 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/lockd 2024-01-24T15:15:35.903 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/lockd/lockd.ko 2024-01-24T15:15:35.903 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/minix 2024-01-24T15:15:35.903 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/minix/minix.ko 2024-01-24T15:15:35.903 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/netfs 2024-01-24T15:15:35.903 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/netfs/netfs.ko 2024-01-24T15:15:35.903 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs 2024-01-24T15:15:35.903 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/blocklayout 2024-01-24T15:15:35.903 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-24T15:15:35.904 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/filelayout 2024-01-24T15:15:35.904 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-24T15:15:35.904 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/flexfilelayout 2024-01-24T15:15:35.904 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-24T15:15:35.904 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/nfs.ko 2024-01-24T15:15:35.904 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/nfsv3.ko 2024-01-24T15:15:35.904 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs/nfsv4.ko 2024-01-24T15:15:35.904 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs_common 2024-01-24T15:15:35.904 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs_common/grace.ko 2024-01-24T15:15:35.904 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfs_common/nfs_acl.ko 2024-01-24T15:15:35.904 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfsd 2024-01-24T15:15:35.904 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nfsd/nfsd.ko 2024-01-24T15:15:35.904 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nilfs2 2024-01-24T15:15:35.904 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nilfs2/nilfs2.ko 2024-01-24T15:15:35.905 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls 2024-01-24T15:15:35.905 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-celtic.ko 2024-01-24T15:15:35.905 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-centeuro.ko 2024-01-24T15:15:35.905 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-croatian.ko 2024-01-24T15:15:35.905 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-cyrillic.ko 2024-01-24T15:15:35.905 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-gaelic.ko 2024-01-24T15:15:35.905 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-greek.ko 2024-01-24T15:15:35.905 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-iceland.ko 2024-01-24T15:15:35.905 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-inuit.ko 2024-01-24T15:15:35.905 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-roman.ko 2024-01-24T15:15:35.905 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-romanian.ko 2024-01-24T15:15:35.905 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/mac-turkish.ko 2024-01-24T15:15:35.905 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp1250.ko 2024-01-24T15:15:35.905 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp1251.ko 2024-01-24T15:15:35.905 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp1255.ko 2024-01-24T15:15:35.905 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp737.ko 2024-01-24T15:15:35.906 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp775.ko 2024-01-24T15:15:35.906 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp850.ko 2024-01-24T15:15:35.906 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp852.ko 2024-01-24T15:15:35.906 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp855.ko 2024-01-24T15:15:35.906 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp857.ko 2024-01-24T15:15:35.906 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp860.ko 2024-01-24T15:15:35.906 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp861.ko 2024-01-24T15:15:35.906 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp862.ko 2024-01-24T15:15:35.906 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp863.ko 2024-01-24T15:15:35.906 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp864.ko 2024-01-24T15:15:35.906 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp865.ko 2024-01-24T15:15:35.906 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp866.ko 2024-01-24T15:15:35.906 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp869.ko 2024-01-24T15:15:35.906 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp874.ko 2024-01-24T15:15:35.906 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp932.ko 2024-01-24T15:15:35.906 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp936.ko 2024-01-24T15:15:35.907 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp949.ko 2024-01-24T15:15:35.907 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_cp950.ko 2024-01-24T15:15:35.907 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_euc-jp.ko 2024-01-24T15:15:35.907 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-1.ko 2024-01-24T15:15:35.907 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-13.ko 2024-01-24T15:15:35.907 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-14.ko 2024-01-24T15:15:35.907 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-15.ko 2024-01-24T15:15:35.907 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-2.ko 2024-01-24T15:15:35.907 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-3.ko 2024-01-24T15:15:35.907 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-4.ko 2024-01-24T15:15:35.907 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-5.ko 2024-01-24T15:15:35.907 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-6.ko 2024-01-24T15:15:35.907 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-7.ko 2024-01-24T15:15:35.908 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_iso8859-9.ko 2024-01-24T15:15:35.908 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_koi8-r.ko 2024-01-24T15:15:35.908 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_koi8-ru.ko 2024-01-24T15:15:35.908 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_koi8-u.ko 2024-01-24T15:15:35.908 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-24T15:15:35.908 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/nls/nls_utf8.ko 2024-01-24T15:15:35.908 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2 2024-01-24T15:15:35.908 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/cluster 2024-01-24T15:15:35.908 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-24T15:15:35.908 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/dlm 2024-01-24T15:15:35.908 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-24T15:15:35.908 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/dlmfs 2024-01-24T15:15:35.908 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-24T15:15:35.908 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ocfs2.ko 2024-01-24T15:15:35.909 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-24T15:15:35.909 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-24T15:15:35.909 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-24T15:15:35.909 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/overlayfs 2024-01-24T15:15:35.909 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/overlayfs/overlay.ko 2024-01-24T15:15:35.909 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/pstore 2024-01-24T15:15:35.909 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/pstore/ramoops.ko 2024-01-24T15:15:35.909 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/reiserfs 2024-01-24T15:15:35.909 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/reiserfs/reiserfs.ko 2024-01-24T15:15:35.909 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/romfs 2024-01-24T15:15:35.909 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/romfs/romfs.ko 2024-01-24T15:15:35.909 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/smb 2024-01-24T15:15:35.909 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/client 2024-01-24T15:15:35.909 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/client/cifs.ko 2024-01-24T15:15:35.909 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/common 2024-01-24T15:15:35.909 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/common/cifs_arc4.ko 2024-01-24T15:15:35.910 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/smb/common/cifs_md4.ko 2024-01-24T15:15:35.910 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/squashfs 2024-01-24T15:15:35.910 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/squashfs/squashfs.ko 2024-01-24T15:15:35.910 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/sysv 2024-01-24T15:15:35.910 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/sysv/sysv.ko 2024-01-24T15:15:35.910 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/udf 2024-01-24T15:15:35.910 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/udf/udf.ko 2024-01-24T15:15:35.910 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ufs 2024-01-24T15:15:35.910 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/ufs/ufs.ko 2024-01-24T15:15:35.910 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/xfs 2024-01-24T15:15:35.910 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/fs/xfs/xfs.ko 2024-01-24T15:15:35.910 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/kernel 2024-01-24T15:15:35.910 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/kernel/rcu 2024-01-24T15:15:35.910 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/kernel/rcu/rcutorture.ko 2024-01-24T15:15:35.910 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/kernel/torture.ko 2024-01-24T15:15:35.910 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/kernel/trace 2024-01-24T15:15:35.911 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-01-24T15:15:35.911 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib 2024-01-24T15:15:35.911 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/asn1_encoder.ko 2024-01-24T15:15:35.911 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/crc-itu-t.ko 2024-01-24T15:15:35.911 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/crc8.ko 2024-01-24T15:15:35.911 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/crypto 2024-01-24T15:15:35.911 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/crypto/libarc4.ko 2024-01-24T15:15:35.911 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/crypto/libdes.ko 2024-01-24T15:15:35.911 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/libcrc32c.ko 2024-01-24T15:15:35.911 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/lru_cache.ko 2024-01-24T15:15:35.911 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/lz4 2024-01-24T15:15:35.911 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/lz4/lz4_compress.ko 2024-01-24T15:15:35.911 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/lz4/lz4hc_compress.ko 2024-01-24T15:15:35.911 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/math 2024-01-24T15:15:35.912 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/math/cordic.ko 2024-01-24T15:15:35.912 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/raid6 2024-01-24T15:15:35.912 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/raid6/raid6_pq.ko 2024-01-24T15:15:35.912 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/reed_solomon 2024-01-24T15:15:35.912 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-24T15:15:35.912 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/ts_bm.ko 2024-01-24T15:15:35.912 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/ts_fsm.ko 2024-01-24T15:15:35.912 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/ts_kmp.ko 2024-01-24T15:15:35.912 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/zstd 2024-01-24T15:15:35.912 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/lib/zstd/zstd_compress.ko 2024-01-24T15:15:35.912 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/mm 2024-01-24T15:15:35.912 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/mm/hwpoison-inject.ko 2024-01-24T15:15:35.912 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net 2024-01-24T15:15:35.912 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan 2024-01-24T15:15:35.912 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/6lowpan.ko 2024-01-24T15:15:35.913 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_dest.ko 2024-01-24T15:15:35.913 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_fragment.ko 2024-01-24T15:15:35.913 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_hop.ko 2024-01-24T15:15:35.913 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-24T15:15:35.913 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_mobility.ko 2024-01-24T15:15:35.913 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_routing.ko 2024-01-24T15:15:35.913 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/6lowpan/nhc_udp.ko 2024-01-24T15:15:35.913 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/802 2024-01-24T15:15:35.913 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/802/garp.ko 2024-01-24T15:15:35.913 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/802/mrp.ko 2024-01-24T15:15:35.913 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/802/p8022.ko 2024-01-24T15:15:35.913 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/802/psnap.ko 2024-01-24T15:15:35.914 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/802/stp.ko 2024-01-24T15:15:35.914 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/8021q 2024-01-24T15:15:35.914 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/8021q/8021q.ko 2024-01-24T15:15:35.914 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/9p 2024-01-24T15:15:35.914 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/9p/9pnet.ko 2024-01-24T15:15:35.914 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/9p/9pnet_fd.ko 2024-01-24T15:15:35.914 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/9p/9pnet_rdma.ko 2024-01-24T15:15:35.914 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/9p/9pnet_virtio.ko 2024-01-24T15:15:35.914 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/batman-adv 2024-01-24T15:15:35.914 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/batman-adv/batman-adv.ko 2024-01-24T15:15:35.914 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge 2024-01-24T15:15:35.914 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/br_netfilter.ko 2024-01-24T15:15:35.914 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/bridge.ko 2024-01-24T15:15:35.914 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter 2024-01-24T15:15:35.914 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-24T15:15:35.915 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-24T15:15:35.915 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-24T15:15:35.915 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-24T15:15:35.915 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-24T15:15:35.915 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-24T15:15:35.915 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-24T15:15:35.915 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-24T15:15:35.915 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-24T15:15:35.915 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-24T15:15:35.915 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-24T15:15:35.915 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-24T15:15:35.915 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-24T15:15:35.915 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-24T15:15:35.915 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-24T15:15:35.916 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-24T15:15:35.916 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-24T15:15:35.916 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-24T15:15:35.916 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-24T15:15:35.916 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-24T15:15:35.916 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/ebtables.ko 2024-01-24T15:15:35.916 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-01-24T15:15:35.916 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-24T15:15:35.916 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-24T15:15:35.916 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ceph 2024-01-24T15:15:35.916 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ceph/libceph.ko 2024-01-24T15:15:35.916 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/core 2024-01-24T15:15:35.916 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/core/failover.ko 2024-01-24T15:15:35.916 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/core/pktgen.ko 2024-01-24T15:15:35.917 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dccp 2024-01-24T15:15:35.917 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/dccp.ko 2024-01-24T15:15:35.917 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/dccp_diag.ko 2024-01-24T15:15:35.917 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/dccp_ipv4.ko 2024-01-24T15:15:35.917 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dccp/dccp_ipv6.ko 2024-01-24T15:15:35.917 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dns_resolver 2024-01-24T15:15:35.917 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dns_resolver/dns_resolver.ko 2024-01-24T15:15:35.917 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dsa 2024-01-24T15:15:35.917 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/dsa_core.ko 2024-01-24T15:15:35.917 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/tag_brcm.ko 2024-01-24T15:15:35.917 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/tag_dsa.ko 2024-01-24T15:15:35.917 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/tag_none.ko 2024-01-24T15:15:35.917 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/dsa/tag_trailer.ko 2024-01-24T15:15:35.918 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154 2024-01-24T15:15:35.918 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/6lowpan 2024-01-24T15:15:35.918 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-24T15:15:35.918 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/ieee802154.ko 2024-01-24T15:15:35.918 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-24T15:15:35.918 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4 2024-01-24T15:15:35.918 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ah4.ko 2024-01-24T15:15:35.918 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/esp4.ko 2024-01-24T15:15:35.918 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/fou.ko 2024-01-24T15:15:35.918 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/gre.ko 2024-01-24T15:15:35.918 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/inet_diag.ko 2024-01-24T15:15:35.918 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ip_gre.ko 2024-01-24T15:15:35.918 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ip_tunnel.ko 2024-01-24T15:15:35.918 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ip_vti.ko 2024-01-24T15:15:35.919 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ipcomp.ko 2024-01-24T15:15:35.919 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/ipip.ko 2024-01-24T15:15:35.919 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter 2024-01-24T15:15:35.919 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-24T15:15:35.919 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-24T15:15:35.919 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-24T15:15:35.919 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-24T15:15:35.919 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-24T15:15:35.919 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-24T15:15:35.919 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-24T15:15:35.919 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-24T15:15:35.919 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-24T15:15:35.919 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-24T15:15:35.919 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-24T15:15:35.919 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-24T15:15:35.920 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-24T15:15:35.920 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-24T15:15:35.920 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-24T15:15:35.920 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-24T15:15:35.920 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-24T15:15:35.920 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-24T15:15:35.920 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-24T15:15:35.920 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-24T15:15:35.920 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-24T15:15:35.920 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_bic.ko 2024-01-24T15:15:35.920 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_dctcp.ko 2024-01-24T15:15:35.920 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_diag.ko 2024-01-24T15:15:35.920 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_highspeed.ko 2024-01-24T15:15:35.921 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_htcp.ko 2024-01-24T15:15:35.921 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_hybla.ko 2024-01-24T15:15:35.921 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_illinois.ko 2024-01-24T15:15:35.921 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_lp.ko 2024-01-24T15:15:35.921 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_scalable.ko 2024-01-24T15:15:35.921 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_vegas.ko 2024-01-24T15:15:35.921 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_veno.ko 2024-01-24T15:15:35.921 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_westwood.ko 2024-01-24T15:15:35.921 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tcp_yeah.ko 2024-01-24T15:15:35.921 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/tunnel4.ko 2024-01-24T15:15:35.921 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/udp_diag.ko 2024-01-24T15:15:35.921 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/udp_tunnel.ko 2024-01-24T15:15:35.921 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-24T15:15:35.922 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6 2024-01-24T15:15:35.922 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ah6.ko 2024-01-24T15:15:35.922 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/esp6.ko 2024-01-24T15:15:35.922 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/fou6.ko 2024-01-24T15:15:35.922 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ip6_tunnel.ko 2024-01-24T15:15:35.922 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-24T15:15:35.922 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ip6_vti.ko 2024-01-24T15:15:35.922 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/ipcomp6.ko 2024-01-24T15:15:35.922 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter 2024-01-24T15:15:35.922 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-24T15:15:35.922 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-24T15:15:35.922 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-24T15:15:35.922 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-24T15:15:35.922 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-24T15:15:35.923 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-24T15:15:35.923 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-24T15:15:35.923 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-24T15:15:35.923 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-24T15:15:35.923 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-24T15:15:35.923 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-24T15:15:35.923 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-24T15:15:35.923 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-24T15:15:35.923 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-24T15:15:35.923 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-24T15:15:35.923 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-24T15:15:35.923 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-24T15:15:35.923 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-24T15:15:35.923 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-24T15:15:35.924 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-24T15:15:35.924 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-24T15:15:35.924 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-24T15:15:35.924 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-24T15:15:35.924 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-24T15:15:35.924 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/sit.ko 2024-01-24T15:15:35.924 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/tunnel6.ko 2024-01-24T15:15:35.924 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-24T15:15:35.924 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/key 2024-01-24T15:15:35.924 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/key/af_key.ko 2024-01-24T15:15:35.924 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp 2024-01-24T15:15:35.924 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_core.ko 2024-01-24T15:15:35.924 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-24T15:15:35.925 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_eth.ko 2024-01-24T15:15:35.925 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_ip.ko 2024-01-24T15:15:35.925 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_ip6.ko 2024-01-24T15:15:35.925 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_netlink.ko 2024-01-24T15:15:35.925 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/l2tp/l2tp_ppp.ko 2024-01-24T15:15:35.925 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/llc 2024-01-24T15:15:35.925 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/llc/llc.ko 2024-01-24T15:15:35.925 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/mac802154 2024-01-24T15:15:35.925 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/mac802154/mac802154.ko 2024-01-24T15:15:35.925 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/mpls 2024-01-24T15:15:35.925 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/mpls/mpls_gso.ko 2024-01-24T15:15:35.925 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter 2024-01-24T15:15:35.925 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset 2024-01-24T15:15:35.925 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set.ko 2024-01-24T15:15:35.925 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-24T15:15:35.925 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-24T15:15:35.926 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-24T15:15:35.926 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-24T15:15:35.926 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-24T15:15:35.926 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-24T15:15:35.926 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-24T15:15:35.926 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-24T15:15:35.926 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-24T15:15:35.926 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-24T15:15:35.926 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-24T15:15:35.926 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-24T15:15:35.926 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-24T15:15:35.926 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-24T15:15:35.926 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-24T15:15:35.926 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs 2024-01-24T15:15:35.926 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-24T15:15:35.926 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-24T15:15:35.927 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-24T15:15:35.927 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-24T15:15:35.927 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-24T15:15:35.927 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-24T15:15:35.927 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-24T15:15:35.927 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-24T15:15:35.927 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-24T15:15:35.927 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-24T15:15:35.927 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-24T15:15:35.927 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-24T15:15:35.927 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-24T15:15:35.927 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-24T15:15:35.927 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conncount.ko 2024-01-24T15:15:35.927 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack.ko 2024-01-24T15:15:35.928 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-24T15:15:35.928 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-24T15:15:35.928 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-24T15:15:35.928 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-24T15:15:35.928 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-24T15:15:35.928 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-24T15:15:35.928 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-24T15:15:35.928 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-24T15:15:35.928 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-24T15:15:35.928 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-24T15:15:35.928 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-24T15:15:35.928 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-24T15:15:35.929 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-24T15:15:35.929 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_flow_table.ko 2024-01-24T15:15:35.929 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-24T15:15:35.929 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_log_syslog.ko 2024-01-24T15:15:35.929 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat.ko 2024-01-24T15:15:35.929 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-24T15:15:35.929 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-24T15:15:35.929 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_irc.ko 2024-01-24T15:15:35.929 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_sip.ko 2024-01-24T15:15:35.929 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-24T15:15:35.929 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-24T15:15:35.929 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nf_tables.ko 2024-01-24T15:15:35.929 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink.ko 2024-01-24T15:15:35.929 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-24T15:15:35.930 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_log.ko 2024-01-24T15:15:35.930 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-24T15:15:35.930 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-24T15:15:35.930 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_chain_nat.ko 2024-01-24T15:15:35.930 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_compat.ko 2024-01-24T15:15:35.930 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_ct.ko 2024-01-24T15:15:35.930 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-24T15:15:35.930 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_fib.ko 2024-01-24T15:15:35.930 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-24T15:15:35.930 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_hash.ko 2024-01-24T15:15:35.930 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_limit.ko 2024-01-24T15:15:35.930 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_log.ko 2024-01-24T15:15:35.930 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_masq.ko 2024-01-24T15:15:35.930 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_nat.ko 2024-01-24T15:15:35.930 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_numgen.ko 2024-01-24T15:15:35.930 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_queue.ko 2024-01-24T15:15:35.931 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_quota.ko 2024-01-24T15:15:35.931 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_redir.ko 2024-01-24T15:15:35.931 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_reject.ko 2024-01-24T15:15:35.931 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_reject_inet.ko 2024-01-24T15:15:35.931 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_socket.ko 2024-01-24T15:15:35.931 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/nft_tunnel.ko 2024-01-24T15:15:35.931 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_AUDIT.ko 2024-01-24T15:15:35.931 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-24T15:15:35.931 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-24T15:15:35.931 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-24T15:15:35.931 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_CT.ko 2024-01-24T15:15:35.931 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_DSCP.ko 2024-01-24T15:15:35.931 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_HL.ko 2024-01-24T15:15:35.931 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_HMARK.ko 2024-01-24T15:15:35.932 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-24T15:15:35.932 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_LED.ko 2024-01-24T15:15:35.932 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_LOG.ko 2024-01-24T15:15:35.932 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-24T15:15:35.932 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_NETMAP.ko 2024-01-24T15:15:35.932 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_NFLOG.ko 2024-01-24T15:15:35.932 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-24T15:15:35.932 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_RATEEST.ko 2024-01-24T15:15:35.932 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-24T15:15:35.932 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_SECMARK.ko 2024-01-24T15:15:35.932 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-24T15:15:35.932 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-24T15:15:35.932 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TEE.ko 2024-01-24T15:15:35.932 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TPROXY.ko 2024-01-24T15:15:35.932 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_TRACE.ko 2024-01-24T15:15:35.933 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_addrtype.ko 2024-01-24T15:15:35.933 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_bpf.ko 2024-01-24T15:15:35.933 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_cgroup.ko 2024-01-24T15:15:35.933 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_cluster.ko 2024-01-24T15:15:35.933 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_comment.ko 2024-01-24T15:15:35.933 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_connbytes.ko 2024-01-24T15:15:35.933 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_connlabel.ko 2024-01-24T15:15:35.933 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_connlimit.ko 2024-01-24T15:15:35.933 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_connmark.ko 2024-01-24T15:15:35.933 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_conntrack.ko 2024-01-24T15:15:35.933 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_cpu.ko 2024-01-24T15:15:35.933 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_dccp.ko 2024-01-24T15:15:35.933 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_devgroup.ko 2024-01-24T15:15:35.933 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_dscp.ko 2024-01-24T15:15:35.934 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_ecn.ko 2024-01-24T15:15:35.934 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_esp.ko 2024-01-24T15:15:35.934 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_hashlimit.ko 2024-01-24T15:15:35.934 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_helper.ko 2024-01-24T15:15:35.934 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_hl.ko 2024-01-24T15:15:35.934 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_ipcomp.ko 2024-01-24T15:15:35.934 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_iprange.ko 2024-01-24T15:15:35.934 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_ipvs.ko 2024-01-24T15:15:35.934 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_l2tp.ko 2024-01-24T15:15:35.934 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_length.ko 2024-01-24T15:15:35.934 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_limit.ko 2024-01-24T15:15:35.934 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_mac.ko 2024-01-24T15:15:35.934 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_mark.ko 2024-01-24T15:15:35.934 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_multiport.ko 2024-01-24T15:15:35.934 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_nat.ko 2024-01-24T15:15:35.934 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_nfacct.ko 2024-01-24T15:15:35.935 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_osf.ko 2024-01-24T15:15:35.935 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_owner.ko 2024-01-24T15:15:35.935 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_physdev.ko 2024-01-24T15:15:35.935 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_pkttype.ko 2024-01-24T15:15:35.935 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_policy.ko 2024-01-24T15:15:35.935 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_quota.ko 2024-01-24T15:15:35.935 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_rateest.ko 2024-01-24T15:15:35.935 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_realm.ko 2024-01-24T15:15:35.935 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_recent.ko 2024-01-24T15:15:35.935 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_sctp.ko 2024-01-24T15:15:35.935 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_set.ko 2024-01-24T15:15:35.935 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_socket.ko 2024-01-24T15:15:35.935 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_state.ko 2024-01-24T15:15:35.935 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_statistic.ko 2024-01-24T15:15:35.935 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_string.ko 2024-01-24T15:15:35.936 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_tcpmss.ko 2024-01-24T15:15:35.936 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_time.ko 2024-01-24T15:15:35.936 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netfilter/xt_u32.ko 2024-01-24T15:15:35.936 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netlink 2024-01-24T15:15:35.936 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/netlink/netlink_diag.ko 2024-01-24T15:15:35.936 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/nsh 2024-01-24T15:15:35.936 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/nsh/nsh.ko 2024-01-24T15:15:35.936 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch 2024-01-24T15:15:35.936 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/openvswitch.ko 2024-01-24T15:15:35.936 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/vport-geneve.ko 2024-01-24T15:15:35.936 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/vport-gre.ko 2024-01-24T15:15:35.936 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/openvswitch/vport-vxlan.ko 2024-01-24T15:15:35.936 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/packet 2024-01-24T15:15:35.936 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/packet/af_packet_diag.ko 2024-01-24T15:15:35.936 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/rds 2024-01-24T15:15:35.937 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/rds/rds.ko 2024-01-24T15:15:35.937 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/rds/rds_rdma.ko 2024-01-24T15:15:35.937 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/rds/rds_tcp.ko 2024-01-24T15:15:35.937 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched 2024-01-24T15:15:35.937 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_csum.ko 2024-01-24T15:15:35.937 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_gact.ko 2024-01-24T15:15:35.937 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_ipt.ko 2024-01-24T15:15:35.937 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_mirred.ko 2024-01-24T15:15:35.937 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_nat.ko 2024-01-24T15:15:35.937 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_pedit.ko 2024-01-24T15:15:35.937 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_police.ko 2024-01-24T15:15:35.937 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_simple.ko 2024-01-24T15:15:35.937 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_skbedit.ko 2024-01-24T15:15:35.937 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/act_vlan.ko 2024-01-24T15:15:35.938 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_basic.ko 2024-01-24T15:15:35.938 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_bpf.ko 2024-01-24T15:15:35.938 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_flow.ko 2024-01-24T15:15:35.938 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_fw.ko 2024-01-24T15:15:35.938 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_route.ko 2024-01-24T15:15:35.938 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/cls_u32.ko 2024-01-24T15:15:35.938 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_cmp.ko 2024-01-24T15:15:35.938 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_ipset.ko 2024-01-24T15:15:35.938 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_meta.ko 2024-01-24T15:15:35.938 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_nbyte.ko 2024-01-24T15:15:35.938 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_text.ko 2024-01-24T15:15:35.938 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/em_u32.ko 2024-01-24T15:15:35.938 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_choke.ko 2024-01-24T15:15:35.938 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_codel.ko 2024-01-24T15:15:35.938 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_drr.ko 2024-01-24T15:15:35.939 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_fq.ko 2024-01-24T15:15:35.939 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_gred.ko 2024-01-24T15:15:35.939 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_hfsc.ko 2024-01-24T15:15:35.939 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_hhf.ko 2024-01-24T15:15:35.939 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_htb.ko 2024-01-24T15:15:35.939 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_ingress.ko 2024-01-24T15:15:35.939 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_mqprio.ko 2024-01-24T15:15:35.939 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_mqprio_lib.ko 2024-01-24T15:15:35.939 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_multiq.ko 2024-01-24T15:15:35.939 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_netem.ko 2024-01-24T15:15:35.939 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_pie.ko 2024-01-24T15:15:35.939 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_plug.ko 2024-01-24T15:15:35.939 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_prio.ko 2024-01-24T15:15:35.939 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_qfq.ko 2024-01-24T15:15:35.939 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_red.ko 2024-01-24T15:15:35.940 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_sfb.ko 2024-01-24T15:15:35.940 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_sfq.ko 2024-01-24T15:15:35.940 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_tbf.ko 2024-01-24T15:15:35.940 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sched/sch_teql.ko 2024-01-24T15:15:35.940 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sctp 2024-01-24T15:15:35.940 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sctp/sctp.ko 2024-01-24T15:15:35.940 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sctp/sctp_diag.ko 2024-01-24T15:15:35.940 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc 2024-01-24T15:15:35.940 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/auth_gss 2024-01-24T15:15:35.940 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-24T15:15:35.940 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-24T15:15:35.940 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/sunrpc.ko 2024-01-24T15:15:35.940 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/xprtrdma 2024-01-24T15:15:35.940 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-24T15:15:35.940 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/tipc 2024-01-24T15:15:35.941 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/tipc/diag.ko 2024-01-24T15:15:35.941 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/tipc/tipc.ko 2024-01-24T15:15:35.941 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/unix 2024-01-24T15:15:35.941 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/unix/unix_diag.ko 2024-01-24T15:15:35.941 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock 2024-01-24T15:15:35.941 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-24T15:15:35.941 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-24T15:15:35.941 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vsock.ko 2024-01-24T15:15:35.941 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-24T15:15:35.941 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-24T15:15:35.941 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/xfrm 2024-01-24T15:15:35.941 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-24T15:15:35.941 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/security 2024-01-24T15:15:35.941 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/security/keys 2024-01-24T15:15:35.941 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/security/keys/encrypted-keys 2024-01-24T15:15:35.942 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-01-24T15:15:35.942 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/security/keys/trusted-keys 2024-01-24T15:15:35.942 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/security/keys/trusted-keys/trusted.ko 2024-01-24T15:15:35.942 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/virt 2024-01-24T15:15:35.942 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/virt/lib 2024-01-24T15:15:35.942 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/kernel/virt/lib/irqbypass.ko 2024-01-24T15:15:35.942 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/modules.alias 2024-01-24T15:15:35.942 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/modules.alias.bin 2024-01-24T15:15:35.942 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/modules.builtin 2024-01-24T15:15:35.942 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/modules.builtin.bin 2024-01-24T15:15:35.942 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/modules.builtin.modinfo 2024-01-24T15:15:35.942 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/modules.dep 2024-01-24T15:15:35.942 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/modules.dep.bin 2024-01-24T15:15:35.942 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/modules.devname 2024-01-24T15:15:35.943 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/modules.order 2024-01-24T15:15:35.943 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/modules.softdep 2024-01-24T15:15:35.943 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/modules.symbols 2024-01-24T15:15:35.943 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.7.0-gf2d346040895/modules.symbols.bin 2024-01-24T15:15:35.943 DEBUG:teuthology.task.kernel:get_image_version: 6.7.0-gf2d346040895 2024-01-24T15:15:35.944 DEBUG:teuthology.orchestra.run.smithi160:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-01-24T15:15:35.966 INFO:teuthology.orchestra.run.smithi160.stdout:postinstall scriptlet (using /bin/sh): 2024-01-24T15:15:35.966 INFO:teuthology.orchestra.run.smithi160.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.7.0-gf2d346040895 -a -r /boot/System.map-6.7.0-gf2d346040895 ]; then 2024-01-24T15:15:35.967 INFO:teuthology.orchestra.run.smithi160.stdout:cp /boot/vmlinuz-6.7.0-gf2d346040895 /boot/.vmlinuz-6.7.0-gf2d346040895-rpm 2024-01-24T15:15:35.967 INFO:teuthology.orchestra.run.smithi160.stdout:cp /boot/System.map-6.7.0-gf2d346040895 /boot/.System.map-6.7.0-gf2d346040895-rpm 2024-01-24T15:15:35.967 INFO:teuthology.orchestra.run.smithi160.stdout:rm -f /boot/vmlinuz-6.7.0-gf2d346040895 /boot/System.map-6.7.0-gf2d346040895 2024-01-24T15:15:35.967 INFO:teuthology.orchestra.run.smithi160.stdout:/sbin/installkernel 6.7.0-gf2d346040895 /boot/.vmlinuz-6.7.0-gf2d346040895-rpm /boot/.System.map-6.7.0-gf2d346040895-rpm 2024-01-24T15:15:35.967 INFO:teuthology.orchestra.run.smithi160.stdout:rm -f /boot/.vmlinuz-6.7.0-gf2d346040895-rpm /boot/.System.map-6.7.0-gf2d346040895-rpm 2024-01-24T15:15:35.967 INFO:teuthology.orchestra.run.smithi160.stdout:fi 2024-01-24T15:15:35.967 INFO:teuthology.orchestra.run.smithi160.stdout:preuninstall scriptlet (using /bin/sh): 2024-01-24T15:15:35.967 INFO:teuthology.orchestra.run.smithi160.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-01-24T15:15:35.967 INFO:teuthology.orchestra.run.smithi160.stdout:new-kernel-pkg --remove 6.7.0-gf2d346040895 --rminitrd --initrdfile=/boot/initramfs-6.7.0-gf2d346040895.img 2024-01-24T15:15:35.967 INFO:teuthology.orchestra.run.smithi160.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-01-24T15:15:35.967 INFO:teuthology.orchestra.run.smithi160.stdout:kernel-install remove 6.7.0-gf2d346040895 2024-01-24T15:15:35.967 INFO:teuthology.orchestra.run.smithi160.stdout:fi 2024-01-24T15:15:35.967 INFO:teuthology.orchestra.run.smithi160.stdout:postuninstall scriptlet (using /bin/sh): 2024-01-24T15:15:35.967 INFO:teuthology.orchestra.run.smithi160.stdout:if [ -x /sbin/update-bootloader ]; then 2024-01-24T15:15:35.968 INFO:teuthology.orchestra.run.smithi160.stdout:/sbin/update-bootloader --remove 6.7.0-gf2d346040895 2024-01-24T15:15:35.968 INFO:teuthology.orchestra.run.smithi160.stdout:fi 2024-01-24T15:15:35.968 DEBUG:teuthology.orchestra.run.smithi160:> sudo rpm -qi grub2-tools 2024-01-24T15:15:36.042 INFO:teuthology.orchestra.run.smithi160.stdout:Name : grub2-tools 2024-01-24T15:15:36.042 INFO:teuthology.orchestra.run.smithi160.stdout:Epoch : 1 2024-01-24T15:15:36.042 INFO:teuthology.orchestra.run.smithi160.stdout:Version : 2.02 2024-01-24T15:15:36.042 INFO:teuthology.orchestra.run.smithi160.stdout:Release : 123.el8 2024-01-24T15:15:36.042 INFO:teuthology.orchestra.run.smithi160.stdout:Architecture: x86_64 2024-01-24T15:15:36.042 INFO:teuthology.orchestra.run.smithi160.stdout:Install Date: Thu 14 Dec 2023 12:39:42 AM UTC 2024-01-24T15:15:36.042 INFO:teuthology.orchestra.run.smithi160.stdout:Group : System Environment/Base 2024-01-24T15:15:36.042 INFO:teuthology.orchestra.run.smithi160.stdout:Size : 9265450 2024-01-24T15:15:36.042 INFO:teuthology.orchestra.run.smithi160.stdout:License : GPLv3+ 2024-01-24T15:15:36.042 INFO:teuthology.orchestra.run.smithi160.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2024-01-24T15:15:36.043 INFO:teuthology.orchestra.run.smithi160.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2024-01-24T15:15:36.043 INFO:teuthology.orchestra.run.smithi160.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2024-01-24T15:15:36.043 INFO:teuthology.orchestra.run.smithi160.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2024-01-24T15:15:36.043 INFO:teuthology.orchestra.run.smithi160.stdout:Relocations : (not relocatable) 2024-01-24T15:15:36.043 INFO:teuthology.orchestra.run.smithi160.stdout:Packager : Red Hat, Inc. 2024-01-24T15:15:36.043 INFO:teuthology.orchestra.run.smithi160.stdout:Vendor : Red Hat, Inc. 2024-01-24T15:15:36.043 INFO:teuthology.orchestra.run.smithi160.stdout:URL : http://www.gnu.org/software/grub/ 2024-01-24T15:15:36.043 INFO:teuthology.orchestra.run.smithi160.stdout:Summary : Support tools for GRUB. 2024-01-24T15:15:36.043 INFO:teuthology.orchestra.run.smithi160.stdout:Description : 2024-01-24T15:15:36.043 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-01-24T15:15:36.043 INFO:teuthology.orchestra.run.smithi160.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-01-24T15:15:36.043 INFO:teuthology.orchestra.run.smithi160.stdout:customizable bootloader with modular architecture. It supports a rich 2024-01-24T15:15:36.043 INFO:teuthology.orchestra.run.smithi160.stdout:variety of kernel formats, file systems, computer architectures and 2024-01-24T15:15:36.043 INFO:teuthology.orchestra.run.smithi160.stdout:hardware devices. 2024-01-24T15:15:36.044 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-01-24T15:15:36.044 INFO:teuthology.orchestra.run.smithi160.stdout:This subpackage provides tools for support of all platforms. 2024-01-24T15:15:36.044 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-01-24T15:15:36.045 INFO:teuthology.task.kernel:Updating grub on smithi160 to boot 6.7.0-gf2d346040895 2024-01-24T15:15:36.045 DEBUG:teuthology.orchestra.run.smithi160:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-01-24T15:15:36.840 INFO:teuthology.orchestra.run.smithi160.stderr:Generating grub configuration file ... 2024-01-24T15:15:38.765 INFO:teuthology.orchestra.run.smithi160.stderr:done 2024-01-24T15:15:38.767 DEBUG:teuthology.orchestra.run.smithi160:> mktemp 2024-01-24T15:15:38.802 INFO:teuthology.orchestra.run.smithi160.stdout:/tmp/tmp.CM44MjAVVo 2024-01-24T15:15:38.802 DEBUG:teuthology.orchestra.run.smithi160:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.CM44MjAVVo 2024-01-24T15:15:38.876 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0666 /tmp/tmp.CM44MjAVVo 2024-01-24T15:15:39.025 DEBUG:teuthology.orchestra.remote:smithi160:/tmp/tmp.CM44MjAVVo is 6KB 2024-01-24T15:15:39.073 DEBUG:teuthology.orchestra.run.smithi160:> rm -fr /tmp/tmp.CM44MjAVVo 2024-01-24T15:15:39.090 DEBUG:teuthology.orchestra.run.smithi160:> sudo /bin/ls /boot/loader/entries || true 2024-01-24T15:15:39.154 INFO:teuthology.orchestra.run.smithi160.stdout:2db68f91c8f90721a6596efe657a5324-0-rescue.conf 2024-01-24T15:15:39.154 INFO:teuthology.orchestra.run.smithi160.stdout:2db68f91c8f90721a6596efe657a5324-6.7.0-gf2d346040895.conf 2024-01-24T15:15:39.155 INFO:teuthology.orchestra.run.smithi160.stdout:963f8b6c99184de696879b3f7da9ecce-0-rescue.conf 2024-01-24T15:15:39.155 INFO:teuthology.orchestra.run.smithi160.stdout:963f8b6c99184de696879b3f7da9ecce-4.18.0-372.9.1.el8.x86_64.conf 2024-01-24T15:15:39.155 INFO:teuthology.orchestra.run.smithi160.stdout:963f8b6c99184de696879b3f7da9ecce-4.18.0-513.9.1.el8_9.x86_64.conf 2024-01-24T15:15:39.156 DEBUG:teuthology.orchestra.run.smithi160:> sudo grub2-set-default 2db68f91c8f90721a6596efe657a5324-6.7.0-gf2d346040895 2024-01-24T15:15:39.335 DEBUG:teuthology.orchestra.run.smithi160:> sudo shutdown -r now 2024-01-24T15:15:50.924 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-01-24T15:15:50.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-01-24T15:15:50.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T15:16:02.197 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-01-24T15:16:02.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-01-24T15:16:02.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T15:16:09.344 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-01-24T15:16:09.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-01-24T15:16:09.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T15:16:36.796 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-01-24T15:16:43.964 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-01-24T15:16:45.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-01-24T15:16:45.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T15:16:50.933 DEBUG:teuthology.orchestra.remote:timed out 2024-01-24T15:16:52.967 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-01-24T15:16:52.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T15:16:59.940 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-01-24T15:16:59.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T15:17:01.393 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-01-24T15:17:01.773 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-01-24T15:17:01.773 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.7.0-gf2d346040895"... 2024-01-24T15:17:01.773 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-01-24T15:17:01.812 INFO:teuthology.orchestra.run.smithi005.stdout:6.7.0-gf2d346040895 2024-01-24T15:17:01.813 DEBUG:teuthology.task.kernel:current kernel version is 6.7.0-gf2d346040895 vs 6.7.0-gf2d346040895 2024-01-24T15:17:01.813 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-24T15:17:01.813 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2024-01-24T15:17:02.813 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-01-24T15:17:02.814 DEBUG:teuthology.orchestra.run.smithi005:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-24T15:17:02.930 INFO:teuthology.orchestra.run.smithi005.stdout:ttyS1 2024-01-24T15:17:02.956 DEBUG:teuthology.parallel:result is None 2024-01-24T15:17:04.188 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-01-24T15:17:11.356 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-01-24T15:17:16.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-01-24T15:17:16.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T15:17:19.260 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-01-24T15:17:23.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-01-24T15:17:23.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T15:17:26.432 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-01-24T15:17:34.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-01-24T15:17:34.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T15:17:34.660 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-01-24T15:17:35.063 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-01-24T15:17:35.063 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "6.7.0-gf2d346040895"... 2024-01-24T15:17:35.063 DEBUG:teuthology.orchestra.run.smithi204:> uname -r 2024-01-24T15:17:35.103 INFO:teuthology.orchestra.run.smithi204.stdout:6.7.0-gf2d346040895 2024-01-24T15:17:35.104 DEBUG:teuthology.task.kernel:current kernel version is 6.7.0-gf2d346040895 vs 6.7.0-gf2d346040895 2024-01-24T15:17:35.104 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-24T15:17:35.104 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2024-01-24T15:17:36.105 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-01-24T15:17:36.105 DEBUG:teuthology.orchestra.run.smithi204:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-24T15:17:36.241 INFO:teuthology.orchestra.run.smithi204.stdout:ttyS1 2024-01-24T15:17:36.261 DEBUG:teuthology.parallel:result is None 2024-01-24T15:17:41.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-01-24T15:17:41.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T15:17:41.777 DEBUG:teuthology.orchestra.run.smithi160:> true 2024-01-24T15:17:42.149 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-01-24T15:17:42.149 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.7.0-gf2d346040895"... 2024-01-24T15:17:42.150 DEBUG:teuthology.orchestra.run.smithi160:> uname -r 2024-01-24T15:17:42.189 INFO:teuthology.orchestra.run.smithi160.stdout:6.7.0-gf2d346040895 2024-01-24T15:17:42.189 DEBUG:teuthology.task.kernel:current kernel version is 6.7.0-gf2d346040895 vs 6.7.0-gf2d346040895 2024-01-24T15:17:42.190 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-24T15:17:42.190 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2024-01-24T15:17:43.190 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-01-24T15:17:43.190 DEBUG:teuthology.orchestra.run.smithi160:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-24T15:17:43.323 INFO:teuthology.orchestra.run.smithi160.stdout:ttyS1 2024-01-24T15:17:43.342 DEBUG:teuthology.parallel:result is None 2024-01-24T15:17:43.343 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-24T15:17:43.354 INFO:teuthology.task.internal:Creating test directory... 2024-01-24T15:17:43.354 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-24T15:17:43.359 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-24T15:17:43.363 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-24T15:17:43.408 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-24T15:17:43.417 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-24T15:17:43.428 INFO:teuthology.task.internal:Creating archive directory... 2024-01-24T15:17:43.428 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-24T15:17:43.432 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-24T15:17:43.445 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-24T15:17:43.512 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-24T15:17:43.520 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-24T15:17:43.521 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-24T15:17:43.525 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-24T15:17:43.529 DEBUG:teuthology.orchestra.run.smithi204:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-24T15:17:43.593 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-24T15:17:43.601 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-24T15:17:43.605 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-24T15:17:43.619 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-24T15:17:43.627 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-24T15:17:43.632 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-24T15:17:43.635 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-24T15:17:43.642 INFO:teuthology.task.internal:Configuring sudo... 2024-01-24T15:17:43.643 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-24T15:17:43.646 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-24T15:17:43.650 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-24T15:17:43.715 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-24T15:17:43.725 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-24T15:17:43.725 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-24T15:17:43.729 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-24T15:17:43.733 DEBUG:teuthology.orchestra.run.smithi204:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-24T15:17:43.773 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-24T15:17:43.875 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-24T15:17:43.961 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-24T15:17:44.029 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-24T15:17:44.110 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-01-24T15:17:44.110 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-24T15:17:44.174 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-24T15:17:44.244 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-24T15:17:44.310 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-24T15:17:44.379 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-24T15:17:44.458 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-01-24T15:17:44.458 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-24T15:17:44.522 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-24T15:17:44.594 DEBUG:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-24T15:17:44.662 DEBUG:teuthology.orchestra.run.smithi204:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-24T15:17:44.731 DEBUG:teuthology.orchestra.run.smithi204:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-24T15:17:44.809 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-01-24T15:17:44.810 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-24T15:17:44.887 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2024-01-24T15:17:44.892 DEBUG:teuthology.orchestra.run.smithi160:> sudo service rsyslog restart 2024-01-24T15:17:44.896 DEBUG:teuthology.orchestra.run.smithi204:> sudo service rsyslog restart 2024-01-24T15:17:44.995 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-24T15:17:45.013 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-24T15:17:45.029 INFO:teuthology.orchestra.run.smithi204.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-24T15:17:45.504 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-24T15:17:45.516 INFO:teuthology.task.internal:Starting timer... 2024-01-24T15:17:45.516 INFO:teuthology.run_tasks:Running task pcp... 2024-01-24T15:17:45.538 INFO:teuthology.run_tasks:Running task selinux... 2024-01-24T15:17:45.559 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-01-24T15:17:45.560 DEBUG:teuthology.orchestra.run.smithi005:> sudo service auditd rotate 2024-01-24T15:17:45.714 INFO:teuthology.orchestra.run.smithi005.stdout:Rotating logs: 2024-01-24T15:17:45.718 DEBUG:teuthology.orchestra.run.smithi160:> sudo service auditd rotate 2024-01-24T15:17:45.880 INFO:teuthology.orchestra.run.smithi160.stdout:Rotating logs: 2024-01-24T15:17:45.885 DEBUG:teuthology.orchestra.run.smithi204:> sudo service auditd rotate 2024-01-24T15:17:46.016 INFO:teuthology.orchestra.run.smithi204.stdout:Rotating logs: 2024-01-24T15:17:46.019 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-24T15:17:46.020 DEBUG:teuthology.orchestra.run.smithi005:> /usr/sbin/getenforce 2024-01-24T15:17:46.063 INFO:teuthology.orchestra.run.smithi005.stdout:Permissive 2024-01-24T15:17:46.063 DEBUG:teuthology.orchestra.run.smithi160:> /usr/sbin/getenforce 2024-01-24T15:17:46.111 INFO:teuthology.orchestra.run.smithi160.stdout:Permissive 2024-01-24T15:17:46.112 DEBUG:teuthology.orchestra.run.smithi204:> /usr/sbin/getenforce 2024-01-24T15:17:46.165 INFO:teuthology.orchestra.run.smithi204.stdout:Permissive 2024-01-24T15:17:46.165 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi005.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi160.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi204.front.sepia.ceph.com': 'permissive'} 2024-01-24T15:17:46.165 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-24T15:17:46.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T15:17:46.231 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-24T15:17:46.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T15:17:46.302 DEBUG:teuthology.orchestra.run.smithi204:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-24T15:17:46.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T15:17:46.370 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-24T15:17:46.370 DEBUG:teuthology.orchestra.run.smithi005:> sudo /usr/sbin/setenforce permissive 2024-01-24T15:17:46.438 DEBUG:teuthology.orchestra.run.smithi160:> sudo /usr/sbin/setenforce permissive 2024-01-24T15:17:46.502 DEBUG:teuthology.orchestra.run.smithi204:> sudo /usr/sbin/setenforce permissive 2024-01-24T15:17:46.568 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-24T15:17:46.580 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-24T15:17:46.596 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-24T15:17:46.597 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi160.front.sepia.ceph.com,smithi204.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-24T15:28:10.537 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi160.front.sepia.ceph.com'), Remote(name='ubuntu@smithi204.front.sepia.ceph.com')] 2024-01-24T15:28:10.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-01-24T15:28:10.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T15:28:10.635 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-01-24T15:28:10.740 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-01-24T15:28:10.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-01-24T15:28:10.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T15:28:10.833 DEBUG:teuthology.orchestra.run.smithi160:> true 2024-01-24T15:28:10.943 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-01-24T15:28:10.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-01-24T15:28:10.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-24T15:28:11.056 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-01-24T15:28:11.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-01-24T15:28:11.175 INFO:teuthology.run_tasks:Running task clock... 2024-01-24T15:28:11.185 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-24T15:28:11.186 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-24T15:28:11.186 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-24T15:28:11.190 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-24T15:28:11.190 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-24T15:28:11.195 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-24T15:28:11.195 DEBUG:teuthology.orchestra.run.smithi204:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-24T15:28:11.261 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-24T15:28:11.263 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-24T15:28:11.290 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-24T15:28:11.295 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-24T15:28:11.296 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-24T15:28:11.322 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-24T15:28:11.387 INFO:teuthology.orchestra.run.smithi160.stderr:sudo: ntpd: command not found 2024-01-24T15:28:11.387 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: ntpd: command not found 2024-01-24T15:28:11.414 INFO:teuthology.orchestra.run.smithi160.stdout:506 Cannot talk to daemon 2024-01-24T15:28:11.414 INFO:teuthology.orchestra.run.smithi005.stdout:506 Cannot talk to daemon 2024-01-24T15:28:11.415 INFO:teuthology.orchestra.run.smithi204.stderr:sudo: ntpd: command not found 2024-01-24T15:28:11.443 INFO:teuthology.orchestra.run.smithi204.stdout:506 Cannot talk to daemon 2024-01-24T15:28:11.446 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-24T15:28:11.448 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-24T15:28:11.474 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-24T15:28:11.478 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-24T15:28:11.481 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-24T15:28:11.506 INFO:teuthology.orchestra.run.smithi204.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-24T15:28:11.569 INFO:teuthology.orchestra.run.smithi160.stderr:bash: ntpq: command not found 2024-01-24T15:28:11.575 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-24T15:28:11.576 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2024-01-24T15:28:11.576 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-24T15:28:11.576 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-24T15:28:11.576 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-24T15:28:11.576 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-24T15:28:11.580 INFO:teuthology.orchestra.run.smithi005.stderr:bash: ntpq: command not found 2024-01-24T15:28:11.587 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-24T15:28:11.587 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-01-24T15:28:11.587 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-24T15:28:11.588 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-24T15:28:11.588 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-24T15:28:11.588 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-24T15:28:11.597 INFO:teuthology.orchestra.run.smithi204.stderr:bash: ntpq: command not found 2024-01-24T15:28:11.604 INFO:teuthology.orchestra.run.smithi204.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-24T15:28:11.604 INFO:teuthology.orchestra.run.smithi204.stdout:=============================================================================== 2024-01-24T15:28:11.604 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-24T15:28:11.605 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-24T15:28:11.605 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-24T15:28:11.605 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-24T15:28:11.607 INFO:teuthology.run_tasks:Running task pexec... 2024-01-24T15:28:11.621 INFO:teuthology.task.pexec:Executing custom commands... 2024-01-24T15:28:11.622 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi005.front.sepia.ceph.com 2024-01-24T15:28:11.622 DEBUG:teuthology.orchestra.run.smithi005:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-01-24T15:28:11.622 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi160.front.sepia.ceph.com 2024-01-24T15:28:11.623 DEBUG:teuthology.orchestra.run.smithi160:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-01-24T15:28:11.623 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi204.front.sepia.ceph.com 2024-01-24T15:28:11.623 DEBUG:teuthology.orchestra.run.smithi204:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-01-24T15:28:12.105 INFO:teuthology.orchestra.run.smithi160.stdout:Updating Subscription Management repositories. 2024-01-24T15:28:12.113 INFO:teuthology.orchestra.run.smithi204.stdout:Updating Subscription Management repositories. 2024-01-24T15:28:12.144 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2024-01-24T15:28:13.953 INFO:teuthology.orchestra.run.smithi160.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 30 kB/s | 4.1 kB 00:00 2024-01-24T15:28:14.058 INFO:teuthology.orchestra.run.smithi204.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 32 kB/s | 4.1 kB 00:00 2024-01-24T15:28:14.263 INFO:teuthology.orchestra.run.smithi005.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 27 kB/s | 4.1 kB 00:00 2024-01-24T15:28:14.338 INFO:teuthology.orchestra.run.smithi160.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 33 kB/s | 4.5 kB 00:00 2024-01-24T15:28:14.514 INFO:teuthology.orchestra.run.smithi204.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 23 kB/s | 4.5 kB 00:00 2024-01-24T15:28:14.601 INFO:teuthology.orchestra.run.smithi005.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 72 kB/s | 4.5 kB 00:00 2024-01-24T15:28:17.363 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-01-24T15:28:17.365 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-01-24T15:28:17.365 INFO:teuthology.orchestra.run.smithi160.stdout: Package Architecture Version Repository Size 2024-01-24T15:28:17.365 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-01-24T15:28:17.365 INFO:teuthology.orchestra.run.smithi160.stdout:Resetting modules: 2024-01-24T15:28:17.365 INFO:teuthology.orchestra.run.smithi160.stdout: container-tools 2024-01-24T15:28:17.365 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-01-24T15:28:17.365 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-01-24T15:28:17.365 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-01-24T15:28:17.365 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-01-24T15:28:17.522 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-01-24T15:28:17.523 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-01-24T15:28:17.523 INFO:teuthology.orchestra.run.smithi204.stdout: Package Architecture Version Repository Size 2024-01-24T15:28:17.523 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-01-24T15:28:17.524 INFO:teuthology.orchestra.run.smithi204.stdout:Resetting modules: 2024-01-24T15:28:17.524 INFO:teuthology.orchestra.run.smithi204.stdout: container-tools 2024-01-24T15:28:17.524 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-01-24T15:28:17.524 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-01-24T15:28:17.524 INFO:teuthology.orchestra.run.smithi204.stdout:================================================================================ 2024-01-24T15:28:17.524 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-01-24T15:28:18.401 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-01-24T15:28:18.402 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-01-24T15:28:18.402 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2024-01-24T15:28:18.403 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-01-24T15:28:18.403 INFO:teuthology.orchestra.run.smithi005.stdout:Resetting modules: 2024-01-24T15:28:18.403 INFO:teuthology.orchestra.run.smithi005.stdout: container-tools 2024-01-24T15:28:18.403 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:28:18.403 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-01-24T15:28:18.403 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-01-24T15:28:18.403 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:28:26.929 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-01-24T15:28:27.451 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-01-24T15:28:27.535 INFO:teuthology.orchestra.run.smithi204.stdout:Updating Subscription Management repositories. 2024-01-24T15:28:28.060 INFO:teuthology.orchestra.run.smithi160.stdout:Updating Subscription Management repositories. 2024-01-24T15:28:28.113 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-01-24T15:28:28.767 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2024-01-24T15:28:29.703 INFO:teuthology.orchestra.run.smithi204.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 90 kB/s | 4.1 kB 00:00 2024-01-24T15:28:30.095 INFO:teuthology.orchestra.run.smithi160.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 39 kB/s | 4.1 kB 00:00 2024-01-24T15:28:30.100 INFO:teuthology.orchestra.run.smithi204.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 34 kB/s | 4.5 kB 00:00 2024-01-24T15:28:30.517 INFO:teuthology.orchestra.run.smithi160.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 27 kB/s | 4.5 kB 00:00 2024-01-24T15:28:30.932 INFO:teuthology.orchestra.run.smithi005.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 24 kB/s | 4.1 kB 00:00 2024-01-24T15:28:31.356 INFO:teuthology.orchestra.run.smithi005.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 34 kB/s | 4.5 kB 00:00 2024-01-24T15:28:33.088 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-01-24T15:28:33.255 INFO:teuthology.orchestra.run.smithi204.stdout:========================================================================================================== 2024-01-24T15:28:33.255 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repository Size 2024-01-24T15:28:33.255 INFO:teuthology.orchestra.run.smithi204.stdout:========================================================================================================== 2024-01-24T15:28:33.255 INFO:teuthology.orchestra.run.smithi204.stdout:Installing group/module packages: 2024-01-24T15:28:33.255 INFO:teuthology.orchestra.run.smithi204.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 1.0 M 2024-01-24T15:28:33.255 INFO:teuthology.orchestra.run.smithi204.stdout: buildah x86_64 1:1.31.3-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 8.8 M 2024-01-24T15:28:33.256 INFO:teuthology.orchestra.run.smithi204.stdout: cockpit-podman noarch 75-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 739 k 2024-01-24T15:28:33.256 INFO:teuthology.orchestra.run.smithi204.stdout: crun x86_64 1.8.7-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 239 k 2024-01-24T15:28:33.256 INFO:teuthology.orchestra.run.smithi204.stdout: netavark x86_64 2:1.7.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-01-24T15:28:33.256 INFO:teuthology.orchestra.run.smithi204.stdout: python3-podman noarch 4.6.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 153 k 2024-01-24T15:28:33.256 INFO:teuthology.orchestra.run.smithi204.stdout: skopeo x86_64 2:1.13.3-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 8.1 M 2024-01-24T15:28:33.256 INFO:teuthology.orchestra.run.smithi204.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 2.5 M 2024-01-24T15:28:33.256 INFO:teuthology.orchestra.run.smithi204.stdout: udica noarch 0.2.6-20.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 49 k 2024-01-24T15:28:33.256 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2024-01-24T15:28:33.256 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2024-01-24T15:28:33.256 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2024-01-24T15:28:33.256 INFO:teuthology.orchestra.run.smithi204.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2024-01-24T15:28:33.257 INFO:teuthology.orchestra.run.smithi204.stdout:Installing weak dependencies: 2024-01-24T15:28:33.257 INFO:teuthology.orchestra.run.smithi204.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2024-01-24T15:28:33.257 INFO:teuthology.orchestra.run.smithi204.stdout:Installing module profiles: 2024-01-24T15:28:33.257 INFO:teuthology.orchestra.run.smithi204.stdout: container-tools/common 2024-01-24T15:28:33.257 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-01-24T15:28:33.257 INFO:teuthology.orchestra.run.smithi204.stdout:Enabling module streams: 2024-01-24T15:28:33.257 INFO:teuthology.orchestra.run.smithi204.stdout: container-tools rhel8 2024-01-24T15:28:33.257 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-01-24T15:28:33.257 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-01-24T15:28:33.257 INFO:teuthology.orchestra.run.smithi204.stdout:========================================================================================================== 2024-01-24T15:28:33.257 INFO:teuthology.orchestra.run.smithi204.stdout:Install 13 Packages 2024-01-24T15:28:33.257 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-01-24T15:28:33.258 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 26 M 2024-01-24T15:28:33.258 INFO:teuthology.orchestra.run.smithi204.stdout:Installed size: 87 M 2024-01-24T15:28:33.258 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-01-24T15:28:33.416 INFO:teuthology.orchestra.run.smithi204.stdout:(1/13): python3-pyxdg-0.25-16.el8.noarch.rpm 599 kB/s | 94 kB 00:00 2024-01-24T15:28:33.441 INFO:teuthology.orchestra.run.smithi204.stdout:(2/13): python3-pytoml-0.1.14-5.git7dea353.el8. 136 kB/s | 25 kB 00:00 2024-01-24T15:28:33.466 INFO:teuthology.orchestra.run.smithi204.stdout:(3/13): yajl-2.1.0-12.el8.x86_64.rpm 198 kB/s | 41 kB 00:00 2024-01-24T15:28:33.483 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-01-24T15:28:33.575 INFO:teuthology.orchestra.run.smithi204.stdout:(4/13): aardvark-dns-1.7.0-1.module+el8.9.0+203 6.3 MB/s | 1.0 MB 00:00 2024-01-24T15:28:33.625 INFO:teuthology.orchestra.run.smithi204.stdout:(5/13): cockpit-podman-75-1.module+el8.9.0+2032 4.5 MB/s | 739 kB 00:00 2024-01-24T15:28:33.645 INFO:teuthology.orchestra.run.smithi160.stdout:========================================================================================================== 2024-01-24T15:28:33.645 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-01-24T15:28:33.646 INFO:teuthology.orchestra.run.smithi160.stdout:========================================================================================================== 2024-01-24T15:28:33.646 INFO:teuthology.orchestra.run.smithi160.stdout:Installing group/module packages: 2024-01-24T15:28:33.646 INFO:teuthology.orchestra.run.smithi160.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 1.0 M 2024-01-24T15:28:33.646 INFO:teuthology.orchestra.run.smithi160.stdout: buildah x86_64 1:1.31.3-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 8.8 M 2024-01-24T15:28:33.646 INFO:teuthology.orchestra.run.smithi160.stdout: cockpit-podman noarch 75-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 739 k 2024-01-24T15:28:33.646 INFO:teuthology.orchestra.run.smithi160.stdout: crun x86_64 1.8.7-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 239 k 2024-01-24T15:28:33.646 INFO:teuthology.orchestra.run.smithi160.stdout: netavark x86_64 2:1.7.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-01-24T15:28:33.646 INFO:teuthology.orchestra.run.smithi160.stdout: python3-podman noarch 4.6.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 153 k 2024-01-24T15:28:33.646 INFO:teuthology.orchestra.run.smithi160.stdout: skopeo x86_64 2:1.13.3-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 8.1 M 2024-01-24T15:28:33.646 INFO:teuthology.orchestra.run.smithi160.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 2.5 M 2024-01-24T15:28:33.646 INFO:teuthology.orchestra.run.smithi160.stdout: udica noarch 0.2.6-20.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 49 k 2024-01-24T15:28:33.647 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-01-24T15:28:33.647 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2024-01-24T15:28:33.647 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2024-01-24T15:28:33.647 INFO:teuthology.orchestra.run.smithi160.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2024-01-24T15:28:33.647 INFO:teuthology.orchestra.run.smithi160.stdout:Installing weak dependencies: 2024-01-24T15:28:33.647 INFO:teuthology.orchestra.run.smithi160.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2024-01-24T15:28:33.647 INFO:teuthology.orchestra.run.smithi160.stdout:Installing module profiles: 2024-01-24T15:28:33.647 INFO:teuthology.orchestra.run.smithi160.stdout: container-tools/common 2024-01-24T15:28:33.647 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-01-24T15:28:33.647 INFO:teuthology.orchestra.run.smithi160.stdout:Enabling module streams: 2024-01-24T15:28:33.647 INFO:teuthology.orchestra.run.smithi160.stdout: container-tools rhel8 2024-01-24T15:28:33.647 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-01-24T15:28:33.647 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-01-24T15:28:33.647 INFO:teuthology.orchestra.run.smithi160.stdout:========================================================================================================== 2024-01-24T15:28:33.647 INFO:teuthology.orchestra.run.smithi160.stdout:Install 13 Packages 2024-01-24T15:28:33.648 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-01-24T15:28:33.648 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 26 M 2024-01-24T15:28:33.648 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 87 M 2024-01-24T15:28:33.648 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-01-24T15:28:33.734 INFO:teuthology.orchestra.run.smithi204.stdout:(6/13): criu-libs-3.18-4.module+el8.9.0+20326+3 248 kB/s | 39 kB 00:00 2024-01-24T15:28:33.759 INFO:teuthology.orchestra.run.smithi204.stdout:(7/13): crun-1.8.7-1.module+el8.9.0+20326+38708 1.8 MB/s | 239 kB 00:00 2024-01-24T15:28:33.766 INFO:teuthology.orchestra.run.smithi160.stdout:(1/13): python3-pytoml-0.1.14-5.git7dea353.el8. 211 kB/s | 25 kB 00:00 2024-01-24T15:28:33.825 INFO:teuthology.orchestra.run.smithi160.stdout:(2/13): python3-pyxdg-0.25-16.el8.noarch.rpm 534 kB/s | 94 kB 00:00 2024-01-24T15:28:33.867 INFO:teuthology.orchestra.run.smithi160.stdout:(3/13): yajl-2.1.0-12.el8.x86_64.rpm 188 kB/s | 41 kB 00:00 2024-01-24T15:28:33.917 INFO:teuthology.orchestra.run.smithi160.stdout:(4/13): aardvark-dns-1.7.0-1.module+el8.9.0+203 6.7 MB/s | 1.0 MB 00:00 2024-01-24T15:28:33.934 INFO:teuthology.orchestra.run.smithi204.stdout:(8/13): buildah-1.31.3-1.module+el8.9.0+20326+3 18 MB/s | 8.8 MB 00:00 2024-01-24T15:28:33.993 INFO:teuthology.orchestra.run.smithi204.stdout:(9/13): python3-podman-4.6.0-1.module+el8.9.0+2 656 kB/s | 153 kB 00:00 2024-01-24T15:28:34.001 INFO:teuthology.orchestra.run.smithi160.stdout:(5/13): criu-libs-3.18-4.module+el8.9.0+20326+3 472 kB/s | 39 kB 00:00 2024-01-24T15:28:34.068 INFO:teuthology.orchestra.run.smithi160.stdout:(6/13): cockpit-podman-75-1.module+el8.9.0+2032 3.6 MB/s | 739 kB 00:00 2024-01-24T15:28:34.121 INFO:teuthology.orchestra.run.smithi204.stdout:(10/13): netavark-1.7.0-1.module+el8.9.0+20326+ 9.6 MB/s | 3.7 MB 00:00 2024-01-24T15:28:34.148 INFO:teuthology.orchestra.run.smithi160.stdout:(7/13): crun-1.8.7-1.module+el8.9.0+20326+38708 1.6 MB/s | 239 kB 00:00 2024-01-24T15:28:34.213 INFO:teuthology.orchestra.run.smithi204.stdout:(11/13): toolbox-0.0.99.4-5.module+el8.9.0+2032 12 MB/s | 2.5 MB 00:00 2024-01-24T15:28:34.237 INFO:teuthology.orchestra.run.smithi204.stdout:(12/13): udica-0.2.6-20.module+el8.9.0+20326+38 424 kB/s | 49 kB 00:00 2024-01-24T15:28:34.276 INFO:teuthology.orchestra.run.smithi160.stdout:(8/13): buildah-1.31.3-1.module+el8.9.0+20326+3 20 MB/s | 8.8 MB 00:00 2024-01-24T15:28:34.302 INFO:teuthology.orchestra.run.smithi160.stdout:(9/13): python3-podman-4.6.0-1.module+el8.9.0+2 998 kB/s | 153 kB 00:00 2024-01-24T15:28:34.402 INFO:teuthology.orchestra.run.smithi160.stdout:(10/13): netavark-1.7.0-1.module+el8.9.0+20326+ 11 MB/s | 3.7 MB 00:00 2024-01-24T15:28:34.421 INFO:teuthology.orchestra.run.smithi204.stdout:(13/13): skopeo-1.13.3-1.module+el8.9.0+20326+3 17 MB/s | 8.1 MB 00:00 2024-01-24T15:28:34.422 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-01-24T15:28:34.422 INFO:teuthology.orchestra.run.smithi204.stdout:Total 22 MB/s | 26 MB 00:01 2024-01-24T15:28:34.494 INFO:teuthology.orchestra.run.smithi160.stdout:(11/13): toolbox-0.0.99.4-5.module+el8.9.0+2032 13 MB/s | 2.5 MB 00:00 2024-01-24T15:28:34.544 INFO:teuthology.orchestra.run.smithi160.stdout:(12/13): udica-0.2.6-20.module+el8.9.0+20326+38 349 kB/s | 49 kB 00:00 2024-01-24T15:28:34.669 INFO:teuthology.orchestra.run.smithi160.stdout:(13/13): skopeo-1.13.3-1.module+el8.9.0+20326+3 21 MB/s | 8.1 MB 00:00 2024-01-24T15:28:34.670 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-01-24T15:28:34.670 INFO:teuthology.orchestra.run.smithi160.stdout:Total 25 MB/s | 26 MB 00:01 2024-01-24T15:28:34.818 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-01-24T15:28:34.883 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-01-24T15:28:34.908 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-01-24T15:28:34.908 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-01-24T15:28:34.992 INFO:teuthology.orchestra.run.smithi005.stdout:========================================================================================================== 2024-01-24T15:28:34.992 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-01-24T15:28:34.993 INFO:teuthology.orchestra.run.smithi005.stdout:========================================================================================================== 2024-01-24T15:28:34.993 INFO:teuthology.orchestra.run.smithi005.stdout:Installing group/module packages: 2024-01-24T15:28:34.993 INFO:teuthology.orchestra.run.smithi005.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 1.0 M 2024-01-24T15:28:34.993 INFO:teuthology.orchestra.run.smithi005.stdout: buildah x86_64 1:1.31.3-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 8.8 M 2024-01-24T15:28:34.993 INFO:teuthology.orchestra.run.smithi005.stdout: cockpit-podman noarch 75-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 739 k 2024-01-24T15:28:34.993 INFO:teuthology.orchestra.run.smithi005.stdout: crun x86_64 1.8.7-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 239 k 2024-01-24T15:28:34.993 INFO:teuthology.orchestra.run.smithi005.stdout: netavark x86_64 2:1.7.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-01-24T15:28:34.993 INFO:teuthology.orchestra.run.smithi005.stdout: python3-podman noarch 4.6.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 153 k 2024-01-24T15:28:34.993 INFO:teuthology.orchestra.run.smithi005.stdout: skopeo x86_64 2:1.13.3-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 8.1 M 2024-01-24T15:28:34.993 INFO:teuthology.orchestra.run.smithi005.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 2.5 M 2024-01-24T15:28:34.994 INFO:teuthology.orchestra.run.smithi005.stdout: udica noarch 0.2.6-20.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 49 k 2024-01-24T15:28:34.994 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-01-24T15:28:34.994 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2024-01-24T15:28:34.994 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2024-01-24T15:28:34.994 INFO:teuthology.orchestra.run.smithi005.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2024-01-24T15:28:34.994 INFO:teuthology.orchestra.run.smithi005.stdout:Installing weak dependencies: 2024-01-24T15:28:34.994 INFO:teuthology.orchestra.run.smithi005.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2024-01-24T15:28:34.994 INFO:teuthology.orchestra.run.smithi005.stdout:Installing module profiles: 2024-01-24T15:28:34.994 INFO:teuthology.orchestra.run.smithi005.stdout: container-tools/common 2024-01-24T15:28:34.995 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:28:34.995 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling module streams: 2024-01-24T15:28:34.995 INFO:teuthology.orchestra.run.smithi005.stdout: container-tools rhel8 2024-01-24T15:28:34.995 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:28:34.995 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-01-24T15:28:34.995 INFO:teuthology.orchestra.run.smithi005.stdout:========================================================================================================== 2024-01-24T15:28:34.995 INFO:teuthology.orchestra.run.smithi005.stdout:Install 13 Packages 2024-01-24T15:28:34.995 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:28:34.996 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 26 M 2024-01-24T15:28:34.996 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 87 M 2024-01-24T15:28:34.996 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-01-24T15:28:35.130 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-01-24T15:28:35.156 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-01-24T15:28:35.156 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-01-24T15:28:35.179 INFO:teuthology.orchestra.run.smithi005.stdout:(1/13): python3-pyxdg-0.25-16.el8.noarch.rpm 511 kB/s | 94 kB 00:00 2024-01-24T15:28:35.205 INFO:teuthology.orchestra.run.smithi005.stdout:(2/13): python3-pytoml-0.1.14-5.git7dea353.el8. 119 kB/s | 25 kB 00:00 2024-01-24T15:28:35.230 INFO:teuthology.orchestra.run.smithi005.stdout:(3/13): yajl-2.1.0-12.el8.x86_64.rpm 175 kB/s | 41 kB 00:00 2024-01-24T15:28:35.305 INFO:teuthology.orchestra.run.smithi005.stdout:(4/13): aardvark-dns-1.7.0-1.module+el8.9.0+203 8.0 MB/s | 1.0 MB 00:00 2024-01-24T15:28:35.356 INFO:teuthology.orchestra.run.smithi005.stdout:(5/13): cockpit-podman-75-1.module+el8.9.0+2032 5.8 MB/s | 739 kB 00:00 2024-01-24T15:28:35.406 INFO:teuthology.orchestra.run.smithi005.stdout:(6/13): criu-libs-3.18-4.module+el8.9.0+20326+3 391 kB/s | 39 kB 00:00 2024-01-24T15:28:35.440 INFO:teuthology.orchestra.run.smithi005.stdout:(7/13): crun-1.8.7-1.module+el8.9.0+20326+38708 2.8 MB/s | 239 kB 00:00 2024-01-24T15:28:35.442 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-01-24T15:28:35.452 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-01-24T15:28:35.615 INFO:teuthology.orchestra.run.smithi005.stdout:(8/13): buildah-1.31.3-1.module+el8.9.0+20326+3 21 MB/s | 8.8 MB 00:00 2024-01-24T15:28:35.665 INFO:teuthology.orchestra.run.smithi005.stdout:(9/13): python3-podman-4.6.0-1.module+el8.9.0+2 681 kB/s | 153 kB 00:00 2024-01-24T15:28:35.667 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-01-24T15:28:35.677 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-01-24T15:28:35.766 INFO:teuthology.orchestra.run.smithi005.stdout:(10/13): netavark-1.7.0-1.module+el8.9.0+20326+ 10 MB/s | 3.7 MB 00:00 2024-01-24T15:28:35.874 INFO:teuthology.orchestra.run.smithi005.stdout:(11/13): toolbox-0.0.99.4-5.module+el8.9.0+2032 12 MB/s | 2.5 MB 00:00 2024-01-24T15:28:35.899 INFO:teuthology.orchestra.run.smithi005.stdout:(12/13): udica-0.2.6-20.module+el8.9.0+20326+38 370 kB/s | 49 kB 00:00 2024-01-24T15:28:36.091 INFO:teuthology.orchestra.run.smithi005.stdout:(13/13): skopeo-1.13.3-1.module+el8.9.0+20326+3 17 MB/s | 8.1 MB 00:00 2024-01-24T15:28:36.092 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-01-24T15:28:36.092 INFO:teuthology.orchestra.run.smithi005.stdout:Total 23 MB/s | 26 MB 00:01 2024-01-24T15:28:36.117 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-01-24T15:28:36.313 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-01-24T15:28:36.331 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 1/13 2024-01-24T15:28:36.529 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 1/13 2024-01-24T15:28:36.566 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-01-24T15:28:36.593 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-01-24T15:28:36.593 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-01-24T15:28:36.916 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084 2/13 2024-01-24T15:28:37.054 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084 2/13 2024-01-24T15:28:37.088 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-01-24T15:28:37.096 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-01-24T15:28:37.110 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x 3/13 2024-01-24T15:28:37.202 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x 3/13 2024-01-24T15:28:37.306 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : yajl-2.1.0-12.el8.x86_64 4/13 2024-01-24T15:28:37.382 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : yajl-2.1.0-12.el8.x86_64 4/13 2024-01-24T15:28:37.515 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2024-01-24T15:28:37.558 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2024-01-24T15:28:37.749 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2024-01-24T15:28:37.764 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-01-24T15:28:37.829 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2024-01-24T15:28:37.955 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-podman-4.6.0-1.module+el8.9.0+20326+387084 7/13 2024-01-24T15:28:38.009 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-podman-4.6.0-1.module+el8.9.0+20326+387084 7/13 2024-01-24T15:28:38.017 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 1/13 2024-01-24T15:28:38.560 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084 2/13 2024-01-24T15:28:38.761 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x 3/13 2024-01-24T15:28:38.891 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 8/13 2024-01-24T15:28:38.926 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 8/13 2024-01-24T15:28:38.949 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : yajl-2.1.0-12.el8.x86_64 4/13 2024-01-24T15:28:39.124 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2024-01-24T15:28:39.166 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x 9/13 2024-01-24T15:28:39.175 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x 9/13 2024-01-24T15:28:39.380 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2024-01-24T15:28:39.542 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarc 10/13 2024-01-24T15:28:39.594 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-podman-4.6.0-1.module+el8.9.0+20326+387084 7/13 2024-01-24T15:28:39.603 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarc 10/13 2024-01-24T15:28:40.457 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x 11/13 2024-01-24T15:28:40.560 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x 11/13 2024-01-24T15:28:40.615 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 8/13 2024-01-24T15:28:40.684 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x8 12/13 2024-01-24T15:28:40.819 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x8 12/13 2024-01-24T15:28:40.830 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 13/13 2024-01-24T15:28:40.842 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x 9/13 2024-01-24T15:28:41.037 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 13/13 2024-01-24T15:28:41.258 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarc 10/13 2024-01-24T15:28:41.508 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 13/13 2024-01-24T15:28:41.508 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2024-01-24T15:28:41.508 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-01-24T15:28:41.508 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 3/13 2024-01-24T15:28:41.508 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084 4/13 2024-01-24T15:28:41.509 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x 5/13 2024-01-24T15:28:41.509 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 6/13 2024-01-24T15:28:41.509 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 7/13 2024-01-24T15:28:41.509 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 8/13 2024-01-24T15:28:41.509 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x 9/13 2024-01-24T15:28:41.509 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-podman-4.6.0-1.module+el8.9.0+20326+387084 10/13 2024-01-24T15:28:41.509 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x8 11/13 2024-01-24T15:28:41.509 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x 12/13 2024-01-24T15:28:41.726 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 13/13 2024-01-24T15:28:41.726 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2024-01-24T15:28:41.726 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-01-24T15:28:41.726 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 3/13 2024-01-24T15:28:41.726 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084 4/13 2024-01-24T15:28:41.726 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x 5/13 2024-01-24T15:28:41.727 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 6/13 2024-01-24T15:28:41.727 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 7/13 2024-01-24T15:28:41.727 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 8/13 2024-01-24T15:28:41.727 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x 9/13 2024-01-24T15:28:41.727 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-podman-4.6.0-1.module+el8.9.0+20326+387084 10/13 2024-01-24T15:28:41.727 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x8 11/13 2024-01-24T15:28:41.727 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x 12/13 2024-01-24T15:28:42.252 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x 11/13 2024-01-24T15:28:42.491 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x8 12/13 2024-01-24T15:28:42.646 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 13/13 2024-01-24T15:28:43.358 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 13/13 2024-01-24T15:28:43.358 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2024-01-24T15:28:43.358 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-01-24T15:28:43.358 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 3/13 2024-01-24T15:28:43.358 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084 4/13 2024-01-24T15:28:43.358 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x 5/13 2024-01-24T15:28:43.358 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 6/13 2024-01-24T15:28:43.358 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 7/13 2024-01-24T15:28:43.358 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 8/13 2024-01-24T15:28:43.358 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x 9/13 2024-01-24T15:28:43.358 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-podman-4.6.0-1.module+el8.9.0+20326+387084 10/13 2024-01-24T15:28:43.358 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x8 11/13 2024-01-24T15:28:43.359 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x 12/13 2024-01-24T15:28:52.862 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarc 13/13 2024-01-24T15:28:52.863 INFO:teuthology.orchestra.run.smithi160.stdout:Installed products updated. 2024-01-24T15:28:53.175 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarc 13/13 2024-01-24T15:28:53.175 INFO:teuthology.orchestra.run.smithi204.stdout:Installed products updated. 2024-01-24T15:28:53.504 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-01-24T15:28:53.504 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-01-24T15:28:53.504 INFO:teuthology.orchestra.run.smithi160.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084d0.x86_64 2024-01-24T15:28:53.504 INFO:teuthology.orchestra.run.smithi160.stdout: buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x86_64 2024-01-24T15:28:53.504 INFO:teuthology.orchestra.run.smithi160.stdout: cockpit-podman-75-1.module+el8.9.0+20326+387084d0.noarch 2024-01-24T15:28:53.504 INFO:teuthology.orchestra.run.smithi160.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2024-01-24T15:28:53.505 INFO:teuthology.orchestra.run.smithi160.stdout: crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 2024-01-24T15:28:53.505 INFO:teuthology.orchestra.run.smithi160.stdout: netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x86_64 2024-01-24T15:28:53.505 INFO:teuthology.orchestra.run.smithi160.stdout: python3-podman-4.6.0-1.module+el8.9.0+20326+387084d0.noarch 2024-01-24T15:28:53.505 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-01-24T15:28:53.505 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-01-24T15:28:53.505 INFO:teuthology.orchestra.run.smithi160.stdout: skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x86_64 2024-01-24T15:28:53.505 INFO:teuthology.orchestra.run.smithi160.stdout: toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x86_64 2024-01-24T15:28:53.505 INFO:teuthology.orchestra.run.smithi160.stdout: udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarch 2024-01-24T15:28:53.505 INFO:teuthology.orchestra.run.smithi160.stdout: yajl-2.1.0-12.el8.x86_64 2024-01-24T15:28:53.505 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-01-24T15:28:53.505 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-01-24T15:28:53.765 DEBUG:teuthology.parallel:result is None 2024-01-24T15:28:53.793 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-01-24T15:28:53.793 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-01-24T15:28:53.794 INFO:teuthology.orchestra.run.smithi204.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084d0.x86_64 2024-01-24T15:28:53.794 INFO:teuthology.orchestra.run.smithi204.stdout: buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x86_64 2024-01-24T15:28:53.794 INFO:teuthology.orchestra.run.smithi204.stdout: cockpit-podman-75-1.module+el8.9.0+20326+387084d0.noarch 2024-01-24T15:28:53.794 INFO:teuthology.orchestra.run.smithi204.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2024-01-24T15:28:53.794 INFO:teuthology.orchestra.run.smithi204.stdout: crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 2024-01-24T15:28:53.794 INFO:teuthology.orchestra.run.smithi204.stdout: netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x86_64 2024-01-24T15:28:53.794 INFO:teuthology.orchestra.run.smithi204.stdout: python3-podman-4.6.0-1.module+el8.9.0+20326+387084d0.noarch 2024-01-24T15:28:53.794 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-01-24T15:28:53.794 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-01-24T15:28:53.794 INFO:teuthology.orchestra.run.smithi204.stdout: skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x86_64 2024-01-24T15:28:53.794 INFO:teuthology.orchestra.run.smithi204.stdout: toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x86_64 2024-01-24T15:28:53.794 INFO:teuthology.orchestra.run.smithi204.stdout: udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarch 2024-01-24T15:28:53.794 INFO:teuthology.orchestra.run.smithi204.stdout: yajl-2.1.0-12.el8.x86_64 2024-01-24T15:28:53.794 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-01-24T15:28:53.795 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-01-24T15:28:54.070 DEBUG:teuthology.parallel:result is None 2024-01-24T15:28:55.774 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarc 13/13 2024-01-24T15:28:55.775 INFO:teuthology.orchestra.run.smithi005.stdout:Installed products updated. 2024-01-24T15:28:56.466 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:28:56.466 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-01-24T15:28:56.466 INFO:teuthology.orchestra.run.smithi005.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084d0.x86_64 2024-01-24T15:28:56.466 INFO:teuthology.orchestra.run.smithi005.stdout: buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x86_64 2024-01-24T15:28:56.466 INFO:teuthology.orchestra.run.smithi005.stdout: cockpit-podman-75-1.module+el8.9.0+20326+387084d0.noarch 2024-01-24T15:28:56.466 INFO:teuthology.orchestra.run.smithi005.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2024-01-24T15:28:56.466 INFO:teuthology.orchestra.run.smithi005.stdout: crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 2024-01-24T15:28:56.466 INFO:teuthology.orchestra.run.smithi005.stdout: netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x86_64 2024-01-24T15:28:56.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-podman-4.6.0-1.module+el8.9.0+20326+387084d0.noarch 2024-01-24T15:28:56.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-01-24T15:28:56.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-01-24T15:28:56.467 INFO:teuthology.orchestra.run.smithi005.stdout: skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x86_64 2024-01-24T15:28:56.467 INFO:teuthology.orchestra.run.smithi005.stdout: toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x86_64 2024-01-24T15:28:56.467 INFO:teuthology.orchestra.run.smithi005.stdout: udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarch 2024-01-24T15:28:56.467 INFO:teuthology.orchestra.run.smithi005.stdout: yajl-2.1.0-12.el8.x86_64 2024-01-24T15:28:56.467 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:28:56.467 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-01-24T15:28:56.722 DEBUG:teuthology.parallel:result is None 2024-01-24T15:28:56.722 INFO:teuthology.run_tasks:Running task install... 2024-01-24T15:28:56.732 DEBUG:teuthology.task.install:project ceph 2024-01-24T15:28:56.732 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134'}} 2024-01-24T15:28:56.732 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134'} 2024-01-24T15:28:56.733 INFO:teuthology.task.install:Using flavor: default 2024-01-24T15:28:56.738 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-01-24T15:28:56.739 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-01-24T15:28:56.739 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134', 'tag': None, 'wait_for_package': False} 2024-01-24T15:28:56.739 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4e3182a65800aed6d4aa2f6b86da3cfd72188134 2024-01-24T15:28:56.742 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134', 'tag': None, 'wait_for_package': False} 2024-01-24T15:28:56.742 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4e3182a65800aed6d4aa2f6b86da3cfd72188134 2024-01-24T15:28:56.743 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134', 'tag': None, 'wait_for_package': False} 2024-01-24T15:28:56.743 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4e3182a65800aed6d4aa2f6b86da3cfd72188134 2024-01-24T15:28:56.889 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/centos/8/flavors/default/ 2024-01-24T15:28:56.889 INFO:teuthology.task.install.rpm:Package version is 18.2.1-341.g4e3182a6 2024-01-24T15:28:56.894 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/centos/8/flavors/default/ 2024-01-24T15:28:56.894 INFO:teuthology.task.install.rpm:Package version is 18.2.1-341.g4e3182a6 2024-01-24T15:28:57.000 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-24T15:28:57.000 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-01-24T15:28:57.001 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-24T15:28:57.013 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-24T15:28:57.013 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-01-24T15:28:57.013 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-24T15:28:57.067 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-01-24T15:28:57.067 DEBUG:teuthology.orchestra.run.smithi005:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4e3182a65800aed6d4aa2f6b86da3cfd72188134/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-24T15:28:57.086 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-01-24T15:28:57.086 DEBUG:teuthology.orchestra.run.smithi204:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4e3182a65800aed6d4aa2f6b86da3cfd72188134/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-24T15:28:57.097 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/centos/8/flavors/default/ 2024-01-24T15:28:57.097 INFO:teuthology.task.install.rpm:Package version is 18.2.1-341.g4e3182a6 2024-01-24T15:28:57.173 DEBUG:teuthology.orchestra.run.smithi005:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-24T15:28:57.194 DEBUG:teuthology.orchestra.run.smithi204:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-24T15:28:57.205 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-24T15:28:57.205 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-01-24T15:28:57.205 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-24T15:28:57.264 DEBUG:teuthology.orchestra.run.smithi005:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-24T15:28:57.278 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-01-24T15:28:57.279 DEBUG:teuthology.orchestra.run.smithi160:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4e3182a65800aed6d4aa2f6b86da3cfd72188134/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-24T15:28:57.285 DEBUG:teuthology.orchestra.run.smithi204:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-24T15:28:57.328 INFO:teuthology.orchestra.run.smithi005.stdout:check_obsoletes = 1 2024-01-24T15:28:57.332 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum clean all 2024-01-24T15:28:57.348 INFO:teuthology.orchestra.run.smithi204.stdout:check_obsoletes = 1 2024-01-24T15:28:57.351 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum clean all 2024-01-24T15:28:57.388 DEBUG:teuthology.orchestra.run.smithi160:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-24T15:28:57.479 DEBUG:teuthology.orchestra.run.smithi160:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-24T15:28:57.542 INFO:teuthology.orchestra.run.smithi160.stdout:check_obsoletes = 1 2024-01-24T15:28:57.546 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum clean all 2024-01-24T15:28:57.798 INFO:teuthology.orchestra.run.smithi204.stdout:Updating Subscription Management repositories. 2024-01-24T15:28:57.808 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2024-01-24T15:28:57.990 INFO:teuthology.orchestra.run.smithi160.stdout:Updating Subscription Management repositories. 2024-01-24T15:28:59.078 INFO:teuthology.orchestra.run.smithi005.stdout:57 files removed 2024-01-24T15:28:59.137 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-01-24T15:28:59.183 INFO:teuthology.orchestra.run.smithi204.stdout:57 files removed 2024-01-24T15:28:59.239 DEBUG:teuthology.orchestra.run.smithi204:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-01-24T15:28:59.432 INFO:teuthology.orchestra.run.smithi160.stdout:57 files removed 2024-01-24T15:28:59.490 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-01-24T15:28:59.614 INFO:teuthology.orchestra.run.smithi005.stdout:Updating Subscription Management repositories. 2024-01-24T15:28:59.689 INFO:teuthology.orchestra.run.smithi204.stdout:Updating Subscription Management repositories. 2024-01-24T15:28:59.932 INFO:teuthology.orchestra.run.smithi160.stdout:Updating Subscription Management repositories. 2024-01-24T15:29:01.415 INFO:teuthology.orchestra.run.smithi005.stdout:ceph packages for x86_64 306 kB/s | 80 kB 00:00 2024-01-24T15:29:01.637 INFO:teuthology.orchestra.run.smithi204.stdout:ceph packages for x86_64 211 kB/s | 80 kB 00:00 2024-01-24T15:29:01.732 INFO:teuthology.orchestra.run.smithi005.stdout:ceph noarch packages 34 kB/s | 9.5 kB 00:00 2024-01-24T15:29:01.916 INFO:teuthology.orchestra.run.smithi160.stdout:ceph packages for x86_64 219 kB/s | 80 kB 00:00 2024-01-24T15:29:01.940 INFO:teuthology.orchestra.run.smithi204.stdout:ceph noarch packages 36 kB/s | 9.5 kB 00:00 2024-01-24T15:29:02.067 INFO:teuthology.orchestra.run.smithi005.stdout:ceph source packages 4.9 kB/s | 1.5 kB 00:00 2024-01-24T15:29:02.230 INFO:teuthology.orchestra.run.smithi204.stdout:ceph source packages 5.6 kB/s | 1.5 kB 00:00 2024-01-24T15:29:02.241 INFO:teuthology.orchestra.run.smithi160.stdout:ceph noarch packages 33 kB/s | 9.5 kB 00:00 2024-01-24T15:29:02.241 INFO:teuthology.orchestra.run.smithi005.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2024-01-24T15:29:02.423 INFO:teuthology.orchestra.run.smithi204.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2024-01-24T15:29:02.634 INFO:teuthology.orchestra.run.smithi160.stdout:ceph source packages 4.1 kB/s | 1.5 kB 00:00 2024-01-24T15:29:02.792 INFO:teuthology.orchestra.run.smithi160.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-01-24T15:29:03.268 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:00 2024-01-24T15:29:03.577 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 21 MB/s | 16 MB 00:00 2024-01-24T15:29:03.609 INFO:teuthology.orchestra.run.smithi204.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2024-01-24T15:29:07.693 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 481 kB/s | 24 kB 00:00 2024-01-24T15:29:07.735 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 368 kB/s | 24 kB 00:00 2024-01-24T15:29:07.790 INFO:teuthology.orchestra.run.smithi204.stdout:lab-extras 445 kB/s | 24 kB 00:00 2024-01-24T15:29:08.462 INFO:teuthology.orchestra.run.smithi160.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 14 MB/s | 8.8 MB 00:00 2024-01-24T15:29:08.835 INFO:teuthology.orchestra.run.smithi204.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 9.1 MB/s | 8.8 MB 00:00 2024-01-24T15:29:09.361 INFO:teuthology.orchestra.run.smithi005.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 41 MB/s | 65 MB 00:01 2024-01-24T15:29:11.606 INFO:teuthology.orchestra.run.smithi160.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 44 MB/s | 65 MB 00:01 2024-01-24T15:29:11.986 INFO:teuthology.orchestra.run.smithi204.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 43 MB/s | 65 MB 00:01 2024-01-24T15:29:21.446 INFO:teuthology.orchestra.run.smithi005.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 38 MB/s | 59 MB 00:01 2024-01-24T15:29:22.939 INFO:teuthology.orchestra.run.smithi160.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 38 MB/s | 59 MB 00:01 2024-01-24T15:29:23.504 INFO:teuthology.orchestra.run.smithi204.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 37 MB/s | 59 MB 00:01 2024-01-24T15:29:33.430 INFO:teuthology.orchestra.run.smithi005.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 15 MB/s | 8.8 MB 00:00 2024-01-24T15:29:39.120 INFO:teuthology.orchestra.run.smithi160.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-01-24T15:29:39.121 INFO:teuthology.orchestra.run.smithi160.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-01-24T15:29:39.139 INFO:teuthology.orchestra.run.smithi160.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-01-24T15:29:39.141 INFO:teuthology.orchestra.run.smithi160.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-01-24T15:29:39.142 INFO:teuthology.orchestra.run.smithi160.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-01-24T15:29:39.144 INFO:teuthology.orchestra.run.smithi160.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-01-24T15:29:39.147 INFO:teuthology.orchestra.run.smithi160.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-01-24T15:29:39.151 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-01-24T15:29:39.153 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-01-24T15:29:39.365 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-01-24T15:29:39.380 INFO:teuthology.orchestra.run.smithi160.stdout:=========================================================================================================================== 2024-01-24T15:29:39.380 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-01-24T15:29:39.380 INFO:teuthology.orchestra.run.smithi160.stdout:=========================================================================================================================== 2024-01-24T15:29:39.380 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-01-24T15:29:39.380 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-13.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-01-24T15:29:39.380 INFO:teuthology.orchestra.run.smithi160.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-01-24T15:29:39.380 INFO:teuthology.orchestra.run.smithi160.stdout: ceph x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 6.4 k 2024-01-24T15:29:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 5.4 M 2024-01-24T15:29:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 852 k 2024-01-24T15:29:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 165 k 2024-01-24T15:29:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 1.6 M 2024-01-24T15:29:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 132 k 2024-01-24T15:29:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 1.8 M 2024-01-24T15:29:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 7.4 M 2024-01-24T15:29:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 50 k 2024-01-24T15:29:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 13 M 2024-01-24T15:29:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 47 M 2024-01-24T15:29:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 262 k 2024-01-24T15:29:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 171 k 2024-01-24T15:29:39.381 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 259 k 2024-01-24T15:29:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-top noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 18 k 2024-01-24T15:29:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-01-24T15:29:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-01-24T15:29:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-01-24T15:29:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 31 k 2024-01-24T15:29:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2 x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 776 k 2024-01-24T15:29:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 139 k 2024-01-24T15:29:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-01-24T15:29:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 100 k 2024-01-24T15:29:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-01-24T15:29:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql x86_64 10.23-3.module+el8.9.0+20831+78489779 rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-01-24T15:29:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-contrib x86_64 10.23-3.module+el8.9.0+20831+78489779 rhel-8-for-x86_64-appstream-rpms 811 k 2024-01-24T15:29:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-server x86_64 10.23-3.module+el8.9.0+20831+78489779 rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-01-24T15:29:39.382 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 197 k 2024-01-24T15:29:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 371 k 2024-01-24T15:29:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 365 k 2024-01-24T15:29:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 107 k 2024-01-24T15:29:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 94 k 2024-01-24T15:29:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 3.4 M 2024-01-24T15:29:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 181 k 2024-01-24T15:29:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-01-24T15:29:39.383 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrading: 2024-01-24T15:29:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-01-24T15:29:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-01-24T15:29:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-01-24T15:29:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: libblkid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-01-24T15:29:39.383 INFO:teuthology.orchestra.run.smithi160.stdout: libfdisk x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 254 k 2024-01-24T15:29:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: libmount x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 237 k 2024-01-24T15:29:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: librados2 x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 3.7 M 2024-01-24T15:29:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1 x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 3.6 M 2024-01-24T15:29:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: libsmartcols x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 179 k 2024-01-24T15:29:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 99 k 2024-01-24T15:29:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-01-24T15:29:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-01-24T15:29:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: util-linux x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-01-24T15:29:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: util-linux-user x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 103 k 2024-01-24T15:29:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-01-24T15:29:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-01-24T15:29:39.384 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-01-24T15:29:39.384 INFO:teuthology.orchestra.run.smithi160.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-01-24T15:29:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 22 M 2024-01-24T15:29:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 23 k 2024-01-24T15:29:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 2.3 M 2024-01-24T15:29:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 242 k 2024-01-24T15:29:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 4.6 M 2024-01-24T15:29:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 18 M 2024-01-24T15:29:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 15 k 2024-01-24T15:29:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 24 k 2024-01-24T15:29:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-01-24T15:29:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-01-24T15:29:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-01-24T15:29:39.385 INFO:teuthology.orchestra.run.smithi160.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-01-24T15:29:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-01-24T15:29:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 141 k 2024-01-24T15:29:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-01-24T15:29:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-01-24T15:29:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-01-24T15:29:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-01-24T15:29:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-01-24T15:29:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq x86_64 0.9.0-4.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2024-01-24T15:29:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1 x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 474 k 2024-01-24T15:29:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-01-24T15:29:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2 x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 6.5 M 2024-01-24T15:29:39.386 INFO:teuthology.orchestra.run.smithi160.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-01-24T15:29:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-01-24T15:29:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-01-24T15:29:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-01-24T15:29:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-01-24T15:29:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-01-24T15:29:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2024-01-24T15:29:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-01-24T15:29:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-01-24T15:29:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-01-24T15:29:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-01-24T15:29:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-01-24T15:29:39.387 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-01-24T15:29:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-01-24T15:29:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-01-24T15:29:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-01-24T15:29:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-01-24T15:29:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 45 k 2024-01-24T15:29:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 123 k 2024-01-24T15:29:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-01-24T15:29:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-01-24T15:29:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-01-24T15:29:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-01-24T15:29:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography x86_64 3.2.1-6.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2024-01-24T15:29:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-01-24T15:29:39.388 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-01-24T15:29:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-01-24T15:29:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-01-24T15:29:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-01-24T15:29:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-01-24T15:29:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-01-24T15:29:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-01-24T15:29:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-01-24T15:29:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-01-24T15:29:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-01-24T15:29:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-01-24T15:29:39.389 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-01-24T15:29:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-01-24T15:29:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-01-24T15:29:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-01-24T15:29:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-01-24T15:29:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-01-24T15:29:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-01-24T15:29:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-01-24T15:29:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-01-24T15:29:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-01-24T15:29:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-01-24T15:29:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-01-24T15:29:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-01-24T15:29:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-01-24T15:29:39.390 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-01-24T15:29:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-01-24T15:29:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-01-24T15:29:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-01-24T15:29:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-01-24T15:29:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-01-24T15:29:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-01-24T15:29:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-01-24T15:29:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-01-24T15:29:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-01-24T15:29:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-01-24T15:29:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-01-24T15:29:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-01-24T15:29:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-01-24T15:29:39.391 INFO:teuthology.orchestra.run.smithi160.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-01-24T15:29:39.392 INFO:teuthology.orchestra.run.smithi160.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-01-24T15:29:39.392 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-01-24T15:29:39.392 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-01-24T15:29:39.392 INFO:teuthology.orchestra.run.smithi160.stdout:Enabling module streams: 2024-01-24T15:29:39.392 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql 10 2024-01-24T15:29:39.392 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-01-24T15:29:39.392 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-01-24T15:29:39.392 INFO:teuthology.orchestra.run.smithi160.stdout:=========================================================================================================================== 2024-01-24T15:29:39.392 INFO:teuthology.orchestra.run.smithi160.stdout:Install 129 Packages 2024-01-24T15:29:39.392 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrade 16 Packages 2024-01-24T15:29:39.392 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-01-24T15:29:39.393 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 212 M 2024-01-24T15:29:39.393 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-01-24T15:29:39.634 INFO:teuthology.orchestra.run.smithi204.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-01-24T15:29:39.636 INFO:teuthology.orchestra.run.smithi204.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-01-24T15:29:39.655 INFO:teuthology.orchestra.run.smithi204.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-01-24T15:29:39.657 INFO:teuthology.orchestra.run.smithi204.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-01-24T15:29:39.658 INFO:teuthology.orchestra.run.smithi204.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-01-24T15:29:39.660 INFO:teuthology.orchestra.run.smithi204.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-01-24T15:29:39.663 INFO:teuthology.orchestra.run.smithi204.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-01-24T15:29:39.667 INFO:teuthology.orchestra.run.smithi204.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-01-24T15:29:39.669 INFO:teuthology.orchestra.run.smithi204.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-01-24T15:29:39.864 INFO:teuthology.orchestra.run.smithi160.stdout:(1/145): ceph-18.2.1-341.g4e3182a6.el8.x86_64.r 30 kB/s | 6.4 kB 00:00 2024-01-24T15:29:39.892 INFO:teuthology.orchestra.run.smithi204.stdout:Dependencies resolved. 2024-01-24T15:29:39.906 INFO:teuthology.orchestra.run.smithi204.stdout:=========================================================================================================================== 2024-01-24T15:29:39.907 INFO:teuthology.orchestra.run.smithi204.stdout: Package Arch Version Repository Size 2024-01-24T15:29:39.907 INFO:teuthology.orchestra.run.smithi204.stdout:=========================================================================================================================== 2024-01-24T15:29:39.907 INFO:teuthology.orchestra.run.smithi204.stdout:Installing: 2024-01-24T15:29:39.907 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-13.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-01-24T15:29:39.907 INFO:teuthology.orchestra.run.smithi204.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-01-24T15:29:39.907 INFO:teuthology.orchestra.run.smithi204.stdout: ceph x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 6.4 k 2024-01-24T15:29:39.907 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 5.4 M 2024-01-24T15:29:39.907 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-fuse x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 852 k 2024-01-24T15:29:39.907 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-immutable-object-cache x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 165 k 2024-01-24T15:29:39.907 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 1.6 M 2024-01-24T15:29:39.907 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-cephadm noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 132 k 2024-01-24T15:29:39.907 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-dashboard noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 1.8 M 2024-01-24T15:29:39.907 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 7.4 M 2024-01-24T15:29:39.908 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-rook noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 50 k 2024-01-24T15:29:39.908 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-radosgw x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 13 M 2024-01-24T15:29:39.908 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-test x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 47 M 2024-01-24T15:29:39.908 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-volume noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 262 k 2024-01-24T15:29:39.908 INFO:teuthology.orchestra.run.smithi204.stdout: cephadm noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 171 k 2024-01-24T15:29:39.908 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-mirror x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 259 k 2024-01-24T15:29:39.908 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-top noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 18 k 2024-01-24T15:29:39.908 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-01-24T15:29:39.908 INFO:teuthology.orchestra.run.smithi204.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-01-24T15:29:39.908 INFO:teuthology.orchestra.run.smithi204.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-01-24T15:29:39.908 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs-devel x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 31 k 2024-01-24T15:29:39.908 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs2 x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 776 k 2024-01-24T15:29:39.908 INFO:teuthology.orchestra.run.smithi204.stdout: librados-devel x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 139 k 2024-01-24T15:29:39.909 INFO:teuthology.orchestra.run.smithi204.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-01-24T15:29:39.909 INFO:teuthology.orchestra.run.smithi204.stdout: libuuid-devel x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 100 k 2024-01-24T15:29:39.909 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-01-24T15:29:39.909 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql x86_64 10.23-3.module+el8.9.0+20831+78489779 rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-01-24T15:29:39.909 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-contrib x86_64 10.23-3.module+el8.9.0+20831+78489779 rhel-8-for-x86_64-appstream-rpms 811 k 2024-01-24T15:29:39.909 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-server x86_64 10.23-3.module+el8.9.0+20831+78489779 rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-01-24T15:29:39.909 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cephfs x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 197 k 2024-01-24T15:29:39.909 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rados x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 371 k 2024-01-24T15:29:39.909 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rbd x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 365 k 2024-01-24T15:29:39.909 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rgw x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 107 k 2024-01-24T15:29:39.909 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-fuse x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 94 k 2024-01-24T15:29:39.909 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-mirror x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 3.4 M 2024-01-24T15:29:39.909 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-nbd x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 181 k 2024-01-24T15:29:39.909 INFO:teuthology.orchestra.run.smithi204.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-01-24T15:29:39.910 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrading: 2024-01-24T15:29:39.910 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-01-24T15:29:39.910 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-01-24T15:29:39.910 INFO:teuthology.orchestra.run.smithi204.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-01-24T15:29:39.910 INFO:teuthology.orchestra.run.smithi204.stdout: libblkid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-01-24T15:29:39.910 INFO:teuthology.orchestra.run.smithi204.stdout: libfdisk x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 254 k 2024-01-24T15:29:39.910 INFO:teuthology.orchestra.run.smithi204.stdout: libmount x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 237 k 2024-01-24T15:29:39.910 INFO:teuthology.orchestra.run.smithi204.stdout: librados2 x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 3.7 M 2024-01-24T15:29:39.910 INFO:teuthology.orchestra.run.smithi204.stdout: librbd1 x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 3.6 M 2024-01-24T15:29:39.910 INFO:teuthology.orchestra.run.smithi204.stdout: libsmartcols x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 179 k 2024-01-24T15:29:39.910 INFO:teuthology.orchestra.run.smithi204.stdout: libuuid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 99 k 2024-01-24T15:29:39.910 INFO:teuthology.orchestra.run.smithi204.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-01-24T15:29:39.910 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-01-24T15:29:39.910 INFO:teuthology.orchestra.run.smithi204.stdout: util-linux x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-01-24T15:29:39.910 INFO:teuthology.orchestra.run.smithi204.stdout: util-linux-user x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 103 k 2024-01-24T15:29:39.911 INFO:teuthology.orchestra.run.smithi204.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-01-24T15:29:39.911 INFO:teuthology.orchestra.run.smithi204.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-01-24T15:29:39.911 INFO:teuthology.orchestra.run.smithi204.stdout:Installing dependencies: 2024-01-24T15:29:39.911 INFO:teuthology.orchestra.run.smithi204.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-01-24T15:29:39.911 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-common x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 22 M 2024-01-24T15:29:39.911 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-grafana-dashboards noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 23 k 2024-01-24T15:29:39.911 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mds x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 2.3 M 2024-01-24T15:29:39.911 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-modules-core noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 242 k 2024-01-24T15:29:39.911 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mon x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 4.6 M 2024-01-24T15:29:39.911 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-osd x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 18 M 2024-01-24T15:29:39.911 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-prometheus-alerts noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 15 k 2024-01-24T15:29:39.911 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-selinux x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 24 k 2024-01-24T15:29:39.911 INFO:teuthology.orchestra.run.smithi204.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-01-24T15:29:39.912 INFO:teuthology.orchestra.run.smithi204.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-01-24T15:29:39.912 INFO:teuthology.orchestra.run.smithi204.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-01-24T15:29:39.912 INFO:teuthology.orchestra.run.smithi204.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-01-24T15:29:39.912 INFO:teuthology.orchestra.run.smithi204.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-01-24T15:29:39.912 INFO:teuthology.orchestra.run.smithi204.stdout: libcephsqlite x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 141 k 2024-01-24T15:29:39.912 INFO:teuthology.orchestra.run.smithi204.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-01-24T15:29:39.912 INFO:teuthology.orchestra.run.smithi204.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-01-24T15:29:39.912 INFO:teuthology.orchestra.run.smithi204.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-01-24T15:29:39.912 INFO:teuthology.orchestra.run.smithi204.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-01-24T15:29:39.912 INFO:teuthology.orchestra.run.smithi204.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-01-24T15:29:39.912 INFO:teuthology.orchestra.run.smithi204.stdout: librabbitmq x86_64 0.9.0-4.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2024-01-24T15:29:39.912 INFO:teuthology.orchestra.run.smithi204.stdout: libradosstriper1 x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 474 k 2024-01-24T15:29:39.912 INFO:teuthology.orchestra.run.smithi204.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-01-24T15:29:39.913 INFO:teuthology.orchestra.run.smithi204.stdout: librgw2 x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 6.5 M 2024-01-24T15:29:39.913 INFO:teuthology.orchestra.run.smithi204.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-01-24T15:29:39.913 INFO:teuthology.orchestra.run.smithi204.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-01-24T15:29:39.913 INFO:teuthology.orchestra.run.smithi204.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-01-24T15:29:39.913 INFO:teuthology.orchestra.run.smithi204.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-01-24T15:29:39.913 INFO:teuthology.orchestra.run.smithi204.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-01-24T15:29:39.913 INFO:teuthology.orchestra.run.smithi204.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-01-24T15:29:39.913 INFO:teuthology.orchestra.run.smithi204.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2024-01-24T15:29:39.913 INFO:teuthology.orchestra.run.smithi204.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-01-24T15:29:39.913 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-01-24T15:29:39.913 INFO:teuthology.orchestra.run.smithi204.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-01-24T15:29:39.913 INFO:teuthology.orchestra.run.smithi204.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-01-24T15:29:39.913 INFO:teuthology.orchestra.run.smithi204.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-01-24T15:29:39.913 INFO:teuthology.orchestra.run.smithi204.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-01-24T15:29:39.913 INFO:teuthology.orchestra.run.smithi204.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-01-24T15:29:39.914 INFO:teuthology.orchestra.run.smithi204.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-01-24T15:29:39.914 INFO:teuthology.orchestra.run.smithi204.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-01-24T15:29:39.914 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-01-24T15:29:39.914 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 45 k 2024-01-24T15:29:39.914 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-common x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 123 k 2024-01-24T15:29:39.914 INFO:teuthology.orchestra.run.smithi204.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-01-24T15:29:39.914 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-01-24T15:29:39.914 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-01-24T15:29:39.914 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-01-24T15:29:39.914 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cryptography x86_64 3.2.1-6.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2024-01-24T15:29:39.914 INFO:teuthology.orchestra.run.smithi204.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-01-24T15:29:39.914 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-01-24T15:29:39.914 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-01-24T15:29:39.914 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-01-24T15:29:39.915 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-01-24T15:29:39.915 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-01-24T15:29:39.915 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-01-24T15:29:39.915 INFO:teuthology.orchestra.run.smithi204.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-01-24T15:29:39.915 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-01-24T15:29:39.915 INFO:teuthology.orchestra.run.smithi204.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-01-24T15:29:39.915 INFO:teuthology.orchestra.run.smithi204.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-01-24T15:29:39.915 INFO:teuthology.orchestra.run.smithi204.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-01-24T15:29:39.915 INFO:teuthology.orchestra.run.smithi204.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-01-24T15:29:39.915 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-01-24T15:29:39.915 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-01-24T15:29:39.915 INFO:teuthology.orchestra.run.smithi204.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-01-24T15:29:39.915 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-01-24T15:29:39.915 INFO:teuthology.orchestra.run.smithi204.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-01-24T15:29:39.916 INFO:teuthology.orchestra.run.smithi204.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-01-24T15:29:39.916 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-01-24T15:29:39.916 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-01-24T15:29:39.916 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-01-24T15:29:39.916 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-01-24T15:29:39.916 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-01-24T15:29:39.916 INFO:teuthology.orchestra.run.smithi204.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-01-24T15:29:39.916 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-01-24T15:29:39.916 INFO:teuthology.orchestra.run.smithi204.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-01-24T15:29:39.916 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-01-24T15:29:39.916 INFO:teuthology.orchestra.run.smithi204.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-01-24T15:29:39.916 INFO:teuthology.orchestra.run.smithi204.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-01-24T15:29:39.916 INFO:teuthology.orchestra.run.smithi204.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-01-24T15:29:39.917 INFO:teuthology.orchestra.run.smithi204.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-01-24T15:29:39.917 INFO:teuthology.orchestra.run.smithi204.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-01-24T15:29:39.917 INFO:teuthology.orchestra.run.smithi204.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-01-24T15:29:39.917 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-01-24T15:29:39.917 INFO:teuthology.orchestra.run.smithi204.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-01-24T15:29:39.917 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-01-24T15:29:39.917 INFO:teuthology.orchestra.run.smithi204.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-01-24T15:29:39.917 INFO:teuthology.orchestra.run.smithi204.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-01-24T15:29:39.917 INFO:teuthology.orchestra.run.smithi204.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-01-24T15:29:39.917 INFO:teuthology.orchestra.run.smithi204.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-01-24T15:29:39.917 INFO:teuthology.orchestra.run.smithi204.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-01-24T15:29:39.917 INFO:teuthology.orchestra.run.smithi204.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-01-24T15:29:39.917 INFO:teuthology.orchestra.run.smithi204.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-01-24T15:29:39.917 INFO:teuthology.orchestra.run.smithi204.stdout:Enabling module streams: 2024-01-24T15:29:39.917 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql 10 2024-01-24T15:29:39.918 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-01-24T15:29:39.918 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction Summary 2024-01-24T15:29:39.918 INFO:teuthology.orchestra.run.smithi204.stdout:=========================================================================================================================== 2024-01-24T15:29:39.918 INFO:teuthology.orchestra.run.smithi204.stdout:Install 129 Packages 2024-01-24T15:29:39.918 INFO:teuthology.orchestra.run.smithi204.stdout:Upgrade 16 Packages 2024-01-24T15:29:39.918 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-01-24T15:29:39.918 INFO:teuthology.orchestra.run.smithi204.stdout:Total download size: 212 M 2024-01-24T15:29:39.918 INFO:teuthology.orchestra.run.smithi204.stdout:Downloading Packages: 2024-01-24T15:29:40.621 INFO:teuthology.orchestra.run.smithi204.stdout:(1/145): ceph-18.2.1-341.g4e3182a6.el8.x86_64.r 24 kB/s | 6.4 kB 00:00 2024-01-24T15:29:40.680 INFO:teuthology.orchestra.run.smithi160.stdout:(2/145): ceph-fuse-18.2.1-341.g4e3182a6.el8.x86 1.0 MB/s | 852 kB 00:00 2024-01-24T15:29:40.856 INFO:teuthology.orchestra.run.smithi160.stdout:(3/145): ceph-immutable-object-cache-18.2.1-341 947 kB/s | 165 kB 00:00 2024-01-24T15:29:41.316 INFO:teuthology.orchestra.run.smithi005.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-01-24T15:29:41.318 INFO:teuthology.orchestra.run.smithi005.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-01-24T15:29:41.338 INFO:teuthology.orchestra.run.smithi005.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-01-24T15:29:41.339 INFO:teuthology.orchestra.run.smithi005.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-01-24T15:29:41.340 INFO:teuthology.orchestra.run.smithi005.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-01-24T15:29:41.342 INFO:teuthology.orchestra.run.smithi005.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-01-24T15:29:41.345 INFO:teuthology.orchestra.run.smithi005.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-01-24T15:29:41.349 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-01-24T15:29:41.351 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-01-24T15:29:41.580 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-01-24T15:29:41.596 INFO:teuthology.orchestra.run.smithi005.stdout:=========================================================================================================================== 2024-01-24T15:29:41.596 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-01-24T15:29:41.596 INFO:teuthology.orchestra.run.smithi005.stdout:=========================================================================================================================== 2024-01-24T15:29:41.596 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-01-24T15:29:41.596 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-13.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-01-24T15:29:41.596 INFO:teuthology.orchestra.run.smithi005.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-01-24T15:29:41.596 INFO:teuthology.orchestra.run.smithi005.stdout: ceph x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 6.4 k 2024-01-24T15:29:41.596 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 5.4 M 2024-01-24T15:29:41.596 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 852 k 2024-01-24T15:29:41.596 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 165 k 2024-01-24T15:29:41.596 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 1.6 M 2024-01-24T15:29:41.597 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 132 k 2024-01-24T15:29:41.597 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 1.8 M 2024-01-24T15:29:41.597 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 7.4 M 2024-01-24T15:29:41.597 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 50 k 2024-01-24T15:29:41.597 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 13 M 2024-01-24T15:29:41.597 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 47 M 2024-01-24T15:29:41.597 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 262 k 2024-01-24T15:29:41.597 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 171 k 2024-01-24T15:29:41.597 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 259 k 2024-01-24T15:29:41.597 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 18 k 2024-01-24T15:29:41.597 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-01-24T15:29:41.597 INFO:teuthology.orchestra.run.smithi005.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-01-24T15:29:41.597 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-01-24T15:29:41.597 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 31 k 2024-01-24T15:29:41.598 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2 x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 776 k 2024-01-24T15:29:41.598 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 139 k 2024-01-24T15:29:41.598 INFO:teuthology.orchestra.run.smithi005.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-01-24T15:29:41.598 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 100 k 2024-01-24T15:29:41.598 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-01-24T15:29:41.598 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql x86_64 10.23-3.module+el8.9.0+20831+78489779 rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-01-24T15:29:41.598 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib x86_64 10.23-3.module+el8.9.0+20831+78489779 rhel-8-for-x86_64-appstream-rpms 811 k 2024-01-24T15:29:41.598 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server x86_64 10.23-3.module+el8.9.0+20831+78489779 rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-01-24T15:29:41.598 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 197 k 2024-01-24T15:29:41.598 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 371 k 2024-01-24T15:29:41.598 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 365 k 2024-01-24T15:29:41.598 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 107 k 2024-01-24T15:29:41.598 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 94 k 2024-01-24T15:29:41.598 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 3.4 M 2024-01-24T15:29:41.599 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 181 k 2024-01-24T15:29:41.599 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-01-24T15:29:41.599 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrading: 2024-01-24T15:29:41.599 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-01-24T15:29:41.599 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-01-24T15:29:41.599 INFO:teuthology.orchestra.run.smithi005.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-01-24T15:29:41.599 INFO:teuthology.orchestra.run.smithi005.stdout: libblkid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-01-24T15:29:41.599 INFO:teuthology.orchestra.run.smithi005.stdout: libfdisk x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 254 k 2024-01-24T15:29:41.599 INFO:teuthology.orchestra.run.smithi005.stdout: libmount x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 237 k 2024-01-24T15:29:41.599 INFO:teuthology.orchestra.run.smithi005.stdout: librados2 x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 3.7 M 2024-01-24T15:29:41.599 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1 x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 3.6 M 2024-01-24T15:29:41.599 INFO:teuthology.orchestra.run.smithi005.stdout: libsmartcols x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 179 k 2024-01-24T15:29:41.600 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 99 k 2024-01-24T15:29:41.600 INFO:teuthology.orchestra.run.smithi005.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-01-24T15:29:41.600 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-01-24T15:29:41.600 INFO:teuthology.orchestra.run.smithi005.stdout: util-linux x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-01-24T15:29:41.600 INFO:teuthology.orchestra.run.smithi005.stdout: util-linux-user x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 103 k 2024-01-24T15:29:41.600 INFO:teuthology.orchestra.run.smithi005.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-01-24T15:29:41.600 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-01-24T15:29:41.600 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-01-24T15:29:41.600 INFO:teuthology.orchestra.run.smithi005.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-01-24T15:29:41.600 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 22 M 2024-01-24T15:29:41.600 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 23 k 2024-01-24T15:29:41.600 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 2.3 M 2024-01-24T15:29:41.600 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 242 k 2024-01-24T15:29:41.600 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 4.6 M 2024-01-24T15:29:41.601 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 18 M 2024-01-24T15:29:41.601 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts noarch 2:18.2.1-341.g4e3182a6.el8 ceph-noarch 15 k 2024-01-24T15:29:41.601 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 24 k 2024-01-24T15:29:41.601 INFO:teuthology.orchestra.run.smithi005.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-01-24T15:29:41.601 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-01-24T15:29:41.601 INFO:teuthology.orchestra.run.smithi005.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-01-24T15:29:41.601 INFO:teuthology.orchestra.run.smithi005.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-01-24T15:29:41.601 INFO:teuthology.orchestra.run.smithi005.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-01-24T15:29:41.601 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 141 k 2024-01-24T15:29:41.601 INFO:teuthology.orchestra.run.smithi005.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-01-24T15:29:41.601 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-01-24T15:29:41.601 INFO:teuthology.orchestra.run.smithi005.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-01-24T15:29:41.601 INFO:teuthology.orchestra.run.smithi005.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-01-24T15:29:41.601 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-01-24T15:29:41.602 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq x86_64 0.9.0-4.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2024-01-24T15:29:41.602 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1 x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 474 k 2024-01-24T15:29:41.602 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-01-24T15:29:41.602 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2 x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 6.5 M 2024-01-24T15:29:41.602 INFO:teuthology.orchestra.run.smithi005.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-01-24T15:29:41.602 INFO:teuthology.orchestra.run.smithi005.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-01-24T15:29:41.602 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-01-24T15:29:41.602 INFO:teuthology.orchestra.run.smithi005.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-01-24T15:29:41.602 INFO:teuthology.orchestra.run.smithi005.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-01-24T15:29:41.602 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-01-24T15:29:41.602 INFO:teuthology.orchestra.run.smithi005.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2024-01-24T15:29:41.602 INFO:teuthology.orchestra.run.smithi005.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-01-24T15:29:41.602 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-01-24T15:29:41.602 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-01-24T15:29:41.602 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-01-24T15:29:41.603 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-01-24T15:29:41.603 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-01-24T15:29:41.603 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-01-24T15:29:41.603 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-01-24T15:29:41.603 INFO:teuthology.orchestra.run.smithi005.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-01-24T15:29:41.603 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-01-24T15:29:41.603 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 45 k 2024-01-24T15:29:41.603 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common x86_64 2:18.2.1-341.g4e3182a6.el8 ceph 123 k 2024-01-24T15:29:41.603 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-01-24T15:29:41.603 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-01-24T15:29:41.603 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-01-24T15:29:41.603 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-01-24T15:29:41.603 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography x86_64 3.2.1-6.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2024-01-24T15:29:41.604 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-01-24T15:29:41.604 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-01-24T15:29:41.604 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-01-24T15:29:41.604 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-01-24T15:29:41.604 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-01-24T15:29:41.604 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-01-24T15:29:41.604 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-01-24T15:29:41.604 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-01-24T15:29:41.604 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-01-24T15:29:41.604 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-01-24T15:29:41.604 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-01-24T15:29:41.604 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-01-24T15:29:41.604 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-01-24T15:29:41.604 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-01-24T15:29:41.605 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-01-24T15:29:41.605 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-01-24T15:29:41.605 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-01-24T15:29:41.605 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-01-24T15:29:41.605 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-01-24T15:29:41.605 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-01-24T15:29:41.605 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-01-24T15:29:41.605 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-01-24T15:29:41.605 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-01-24T15:29:41.605 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-01-24T15:29:41.605 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-01-24T15:29:41.605 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-01-24T15:29:41.605 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-01-24T15:29:41.605 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-01-24T15:29:41.606 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-01-24T15:29:41.606 INFO:teuthology.orchestra.run.smithi005.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-01-24T15:29:41.606 INFO:teuthology.orchestra.run.smithi005.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-01-24T15:29:41.606 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-01-24T15:29:41.606 INFO:teuthology.orchestra.run.smithi005.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-01-24T15:29:41.606 INFO:teuthology.orchestra.run.smithi005.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-01-24T15:29:41.606 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-01-24T15:29:41.606 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-01-24T15:29:41.606 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-01-24T15:29:41.606 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-01-24T15:29:41.606 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-01-24T15:29:41.606 INFO:teuthology.orchestra.run.smithi005.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-01-24T15:29:41.606 INFO:teuthology.orchestra.run.smithi005.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-01-24T15:29:41.606 INFO:teuthology.orchestra.run.smithi005.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-01-24T15:29:41.606 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-01-24T15:29:41.606 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-01-24T15:29:41.607 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling module streams: 2024-01-24T15:29:41.607 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql 10 2024-01-24T15:29:41.607 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:29:41.607 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-01-24T15:29:41.607 INFO:teuthology.orchestra.run.smithi005.stdout:=========================================================================================================================== 2024-01-24T15:29:41.607 INFO:teuthology.orchestra.run.smithi005.stdout:Install 129 Packages 2024-01-24T15:29:41.607 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade 16 Packages 2024-01-24T15:29:41.607 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:29:41.607 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 212 M 2024-01-24T15:29:41.608 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-01-24T15:29:41.771 INFO:teuthology.orchestra.run.smithi204.stdout:(2/145): ceph-common-18.2.1-341.g4e3182a6.el8.x 15 MB/s | 22 MB 00:01 2024-01-24T15:29:41.789 INFO:teuthology.orchestra.run.smithi160.stdout:(4/145): ceph-base-18.2.1-341.g4e3182a6.el8.x86 2.5 MB/s | 5.4 MB 00:02 2024-01-24T15:29:41.813 INFO:teuthology.orchestra.run.smithi204.stdout:(3/145): ceph-fuse-18.2.1-341.g4e3182a6.el8.x86 715 kB/s | 852 kB 00:01 2024-01-24T15:29:41.838 INFO:teuthology.orchestra.run.smithi204.stdout:(4/145): ceph-immutable-object-cache-18.2.1-341 2.4 MB/s | 165 kB 00:00 2024-01-24T15:29:41.980 INFO:teuthology.orchestra.run.smithi204.stdout:(5/145): ceph-mgr-18.2.1-341.g4e3182a6.el8.x86_ 11 MB/s | 1.6 MB 00:00 2024-01-24T15:29:42.031 INFO:teuthology.orchestra.run.smithi160.stdout:(5/145): ceph-mds-18.2.1-341.g4e3182a6.el8.x86_ 2.0 MB/s | 2.3 MB 00:01 2024-01-24T15:29:42.173 INFO:teuthology.orchestra.run.smithi160.stdout:(6/145): ceph-mgr-18.2.1-341.g4e3182a6.el8.x86_ 4.1 MB/s | 1.6 MB 00:00 2024-01-24T15:29:42.289 INFO:teuthology.orchestra.run.smithi204.stdout:(6/145): ceph-mon-18.2.1-341.g4e3182a6.el8.x86_ 15 MB/s | 4.6 MB 00:00 2024-01-24T15:29:42.398 INFO:teuthology.orchestra.run.smithi005.stdout:(1/145): ceph-18.2.1-341.g4e3182a6.el8.x86_64.r 18 kB/s | 6.4 kB 00:00 2024-01-24T15:29:43.264 INFO:teuthology.orchestra.run.smithi204.stdout:(7/145): ceph-mds-18.2.1-341.g4e3182a6.el8.x86_ 1.6 MB/s | 2.3 MB 00:01 2024-01-24T15:29:43.606 INFO:teuthology.orchestra.run.smithi005.stdout:(2/145): ceph-fuse-18.2.1-341.g4e3182a6.el8.x86 705 kB/s | 852 kB 00:01 2024-01-24T15:29:43.807 INFO:teuthology.orchestra.run.smithi005.stdout:(3/145): ceph-immutable-object-cache-18.2.1-341 828 kB/s | 165 kB 00:00 2024-01-24T15:29:44.664 INFO:teuthology.orchestra.run.smithi204.stdout:(8/145): ceph-osd-18.2.1-341.g4e3182a6.el8.x86_ 7.5 MB/s | 18 MB 00:02 2024-01-24T15:29:44.714 INFO:teuthology.orchestra.run.smithi204.stdout:(9/145): ceph-selinux-18.2.1-341.g4e3182a6.el8. 488 kB/s | 24 kB 00:00 2024-01-24T15:29:44.799 INFO:teuthology.orchestra.run.smithi160.stdout:(7/145): ceph-mon-18.2.1-341.g4e3182a6.el8.x86_ 1.7 MB/s | 4.6 MB 00:02 2024-01-24T15:29:45.190 INFO:teuthology.orchestra.run.smithi005.stdout:(4/145): ceph-mds-18.2.1-341.g4e3182a6.el8.x86_ 1.7 MB/s | 2.3 MB 00:01 2024-01-24T15:29:45.298 INFO:teuthology.orchestra.run.smithi160.stdout:(8/145): ceph-osd-18.2.1-341.g4e3182a6.el8.x86_ 5.7 MB/s | 18 MB 00:03 2024-01-24T15:29:45.415 INFO:teuthology.orchestra.run.smithi160.stdout:(9/145): ceph-selinux-18.2.1-341.g4e3182a6.el8. 209 kB/s | 24 kB 00:00 2024-01-24T15:29:45.632 INFO:teuthology.orchestra.run.smithi005.stdout:(5/145): ceph-base-18.2.1-341.g4e3182a6.el8.x86 1.5 MB/s | 5.4 MB 00:03 2024-01-24T15:29:45.799 INFO:teuthology.orchestra.run.smithi005.stdout:(6/145): ceph-mgr-18.2.1-341.g4e3182a6.el8.x86_ 2.6 MB/s | 1.6 MB 00:00 2024-01-24T15:29:46.016 INFO:teuthology.orchestra.run.smithi160.stdout:(10/145): ceph-common-18.2.1-341.g4e3182a6.el8. 3.4 MB/s | 22 MB 00:06 2024-01-24T15:29:46.216 INFO:teuthology.orchestra.run.smithi160.stdout:(11/145): cephfs-mirror-18.2.1-341.g4e3182a6.el 1.3 MB/s | 259 kB 00:00 2024-01-24T15:29:46.333 INFO:teuthology.orchestra.run.smithi160.stdout:(12/145): libcephfs-devel-18.2.1-341.g4e3182a6. 266 kB/s | 31 kB 00:00 2024-01-24T15:29:46.683 INFO:teuthology.orchestra.run.smithi160.stdout:(13/145): libcephfs2-18.2.1-341.g4e3182a6.el8.x 2.2 MB/s | 776 kB 00:00 2024-01-24T15:29:46.816 INFO:teuthology.orchestra.run.smithi160.stdout:(14/145): libcephsqlite-18.2.1-341.g4e3182a6.el 1.0 MB/s | 141 kB 00:00 2024-01-24T15:29:46.933 INFO:teuthology.orchestra.run.smithi160.stdout:(15/145): librados-devel-18.2.1-341.g4e3182a6.e 1.2 MB/s | 139 kB 00:00 2024-01-24T15:29:47.150 INFO:teuthology.orchestra.run.smithi160.stdout:(16/145): libradosstriper1-18.2.1-341.g4e3182a6 2.1 MB/s | 474 kB 00:00 2024-01-24T15:29:47.216 INFO:teuthology.orchestra.run.smithi005.stdout:(7/145): ceph-common-18.2.1-341.g4e3182a6.el8.x 4.2 MB/s | 22 MB 00:05 2024-01-24T15:29:47.264 INFO:teuthology.orchestra.run.smithi204.stdout:(10/145): ceph-base-18.2.1-341.g4e3182a6.el8.x8 798 kB/s | 5.4 MB 00:06 2024-01-24T15:29:47.481 INFO:teuthology.orchestra.run.smithi204.stdout:(11/145): ceph-radosgw-18.2.1-341.g4e3182a6.el8 3.1 MB/s | 13 MB 00:04 2024-01-24T15:29:47.590 INFO:teuthology.orchestra.run.smithi204.stdout:(12/145): libcephfs-devel-18.2.1-341.g4e3182a6. 286 kB/s | 31 kB 00:00 2024-01-24T15:29:47.707 INFO:teuthology.orchestra.run.smithi204.stdout:(13/145): cephfs-mirror-18.2.1-341.g4e3182a6.el 585 kB/s | 259 kB 00:00 2024-01-24T15:29:47.933 INFO:teuthology.orchestra.run.smithi204.stdout:(14/145): libcephfs2-18.2.1-341.g4e3182a6.el8.x 2.2 MB/s | 776 kB 00:00 2024-01-24T15:29:48.008 INFO:teuthology.orchestra.run.smithi005.stdout:(8/145): ceph-mon-18.2.1-341.g4e3182a6.el8.x86_ 1.9 MB/s | 4.6 MB 00:02 2024-01-24T15:29:48.049 INFO:teuthology.orchestra.run.smithi204.stdout:(15/145): libcephsqlite-18.2.1-341.g4e3182a6.el 413 kB/s | 141 kB 00:00 2024-01-24T15:29:48.066 INFO:teuthology.orchestra.run.smithi204.stdout:(16/145): librados-devel-18.2.1-341.g4e3182a6.e 1.0 MB/s | 139 kB 00:00 2024-01-24T15:29:48.099 INFO:teuthology.orchestra.run.smithi005.stdout:(9/145): ceph-selinux-18.2.1-341.g4e3182a6.el8. 266 kB/s | 24 kB 00:00 2024-01-24T15:29:48.633 INFO:teuthology.orchestra.run.smithi204.stdout:(17/145): libradosstriper1-18.2.1-341.g4e3182a6 813 kB/s | 474 kB 00:00 2024-01-24T15:29:48.742 INFO:teuthology.orchestra.run.smithi204.stdout:(18/145): python3-ceph-argparse-18.2.1-341.g4e3 413 kB/s | 45 kB 00:00 2024-01-24T15:29:48.850 INFO:teuthology.orchestra.run.smithi160.stdout:(17/145): librgw2-18.2.1-341.g4e3182a6.el8.x86_ 3.9 MB/s | 6.5 MB 00:01 2024-01-24T15:29:48.908 INFO:teuthology.orchestra.run.smithi204.stdout:(19/145): python3-ceph-common-18.2.1-341.g4e318 743 kB/s | 123 kB 00:00 2024-01-24T15:29:48.959 INFO:teuthology.orchestra.run.smithi160.stdout:(18/145): python3-ceph-argparse-18.2.1-341.g4e3 413 kB/s | 45 kB 00:00 2024-01-24T15:29:49.067 INFO:teuthology.orchestra.run.smithi160.stdout:(19/145): python3-ceph-common-18.2.1-341.g4e318 1.1 MB/s | 123 kB 00:00 2024-01-24T15:29:49.184 INFO:teuthology.orchestra.run.smithi204.stdout:(20/145): python3-cephfs-18.2.1-341.g4e3182a6.e 715 kB/s | 197 kB 00:00 2024-01-24T15:29:49.184 INFO:teuthology.orchestra.run.smithi160.stdout:(20/145): python3-cephfs-18.2.1-341.g4e3182a6.e 1.6 MB/s | 197 kB 00:00 2024-01-24T15:29:49.376 INFO:teuthology.orchestra.run.smithi160.stdout:(21/145): python3-rados-18.2.1-341.g4e3182a6.el 1.9 MB/s | 371 kB 00:00 2024-01-24T15:29:49.491 INFO:teuthology.orchestra.run.smithi005.stdout:(10/145): ceph-radosgw-18.2.1-341.g4e3182a6.el8 5.7 MB/s | 13 MB 00:02 2024-01-24T15:29:49.543 INFO:teuthology.orchestra.run.smithi160.stdout:(22/145): python3-rbd-18.2.1-341.g4e3182a6.el8. 2.1 MB/s | 365 kB 00:00 2024-01-24T15:29:49.559 INFO:teuthology.orchestra.run.smithi204.stdout:(21/145): python3-rados-18.2.1-341.g4e3182a6.el 990 kB/s | 371 kB 00:00 2024-01-24T15:29:49.583 INFO:teuthology.orchestra.run.smithi005.stdout:(11/145): cephfs-mirror-18.2.1-341.g4e3182a6.el 2.8 MB/s | 259 kB 00:00 2024-01-24T15:29:49.643 INFO:teuthology.orchestra.run.smithi160.stdout:(23/145): python3-rgw-18.2.1-341.g4e3182a6.el8. 1.0 MB/s | 107 kB 00:00 2024-01-24T15:29:49.650 INFO:teuthology.orchestra.run.smithi005.stdout:(12/145): libcephfs-devel-18.2.1-341.g4e3182a6. 463 kB/s | 31 kB 00:00 2024-01-24T15:29:49.760 INFO:teuthology.orchestra.run.smithi160.stdout:(24/145): rbd-fuse-18.2.1-341.g4e3182a6.el8.x86 809 kB/s | 94 kB 00:00 2024-01-24T15:29:49.817 INFO:teuthology.orchestra.run.smithi005.stdout:(13/145): libcephfs2-18.2.1-341.g4e3182a6.el8.x 4.6 MB/s | 776 kB 00:00 2024-01-24T15:29:49.884 INFO:teuthology.orchestra.run.smithi005.stdout:(14/145): libcephsqlite-18.2.1-341.g4e3182a6.el 2.1 MB/s | 141 kB 00:00 2024-01-24T15:29:49.901 INFO:teuthology.orchestra.run.smithi204.stdout:(22/145): librgw2-18.2.1-341.g4e3182a6.el8.x86_ 3.6 MB/s | 6.5 MB 00:01 2024-01-24T15:29:49.951 INFO:teuthology.orchestra.run.smithi005.stdout:(15/145): librados-devel-18.2.1-341.g4e3182a6.e 2.0 MB/s | 139 kB 00:00 2024-01-24T15:29:49.964 INFO:teuthology.orchestra.run.smithi204.stdout:(23/145): python3-rbd-18.2.1-341.g4e3182a6.el8. 902 kB/s | 365 kB 00:00 2024-01-24T15:29:50.001 INFO:teuthology.orchestra.run.smithi204.stdout:(24/145): python3-rgw-18.2.1-341.g4e3182a6.el8. 1.0 MB/s | 107 kB 00:00 2024-01-24T15:29:50.076 INFO:teuthology.orchestra.run.smithi005.stdout:(16/145): libradosstriper1-18.2.1-341.g4e3182a6 3.7 MB/s | 474 kB 00:00 2024-01-24T15:29:50.118 INFO:teuthology.orchestra.run.smithi204.stdout:(25/145): rbd-fuse-18.2.1-341.g4e3182a6.el8.x86 611 kB/s | 94 kB 00:00 2024-01-24T15:29:50.385 INFO:teuthology.orchestra.run.smithi204.stdout:(26/145): rbd-nbd-18.2.1-341.g4e3182a6.el8.x86_ 678 kB/s | 181 kB 00:00 2024-01-24T15:29:50.502 INFO:teuthology.orchestra.run.smithi204.stdout:(27/145): ceph-grafana-dashboards-18.2.1-341.g4 197 kB/s | 23 kB 00:00 2024-01-24T15:29:50.652 INFO:teuthology.orchestra.run.smithi160.stdout:(25/145): rbd-mirror-18.2.1-341.g4e3182a6.el8.x 3.9 MB/s | 3.4 MB 00:00 2024-01-24T15:29:50.694 INFO:teuthology.orchestra.run.smithi204.stdout:(28/145): ceph-mgr-cephadm-18.2.1-341.g4e3182a6 688 kB/s | 132 kB 00:00 2024-01-24T15:29:50.761 INFO:teuthology.orchestra.run.smithi160.stdout:(26/145): rbd-nbd-18.2.1-341.g4e3182a6.el8.x86_ 1.6 MB/s | 181 kB 00:00 2024-01-24T15:29:50.869 INFO:teuthology.orchestra.run.smithi160.stdout:(27/145): ceph-grafana-dashboards-18.2.1-341.g4 214 kB/s | 23 kB 00:00 2024-01-24T15:29:50.978 INFO:teuthology.orchestra.run.smithi160.stdout:(28/145): ceph-mgr-cephadm-18.2.1-341.g4e3182a6 1.2 MB/s | 132 kB 00:00 2024-01-24T15:29:51.061 INFO:teuthology.orchestra.run.smithi204.stdout:(29/145): rbd-mirror-18.2.1-341.g4e3182a6.el8.x 3.3 MB/s | 3.4 MB 00:01 2024-01-24T15:29:51.237 INFO:teuthology.orchestra.run.smithi160.stdout:(29/145): ceph-radosgw-18.2.1-341.g4e3182a6.el8 2.0 MB/s | 13 MB 00:06 2024-01-24T15:29:51.326 INFO:teuthology.orchestra.run.smithi005.stdout:(17/145): librgw2-18.2.1-341.g4e3182a6.el8.x86_ 5.2 MB/s | 6.5 MB 00:01 2024-01-24T15:29:51.410 INFO:teuthology.orchestra.run.smithi005.stdout:(18/145): python3-ceph-argparse-18.2.1-341.g4e3 536 kB/s | 45 kB 00:00 2024-01-24T15:29:51.471 INFO:teuthology.orchestra.run.smithi160.stdout:(30/145): ceph-mgr-dashboard-18.2.1-341.g4e3182 3.6 MB/s | 1.8 MB 00:00 2024-01-24T15:29:51.493 INFO:teuthology.orchestra.run.smithi005.stdout:(19/145): python3-ceph-common-18.2.1-341.g4e318 1.5 MB/s | 123 kB 00:00 2024-01-24T15:29:51.571 INFO:teuthology.orchestra.run.smithi160.stdout:(31/145): ceph-mgr-modules-core-18.2.1-341.g4e3 2.4 MB/s | 242 kB 00:00 2024-01-24T15:29:51.586 INFO:teuthology.orchestra.run.smithi005.stdout:(20/145): python3-cephfs-18.2.1-341.g4e3182a6.e 2.1 MB/s | 197 kB 00:00 2024-01-24T15:29:51.654 INFO:teuthology.orchestra.run.smithi160.stdout:(32/145): ceph-mgr-rook-18.2.1-341.g4e3182a6.el 605 kB/s | 50 kB 00:00 2024-01-24T15:29:51.720 INFO:teuthology.orchestra.run.smithi005.stdout:(21/145): python3-rados-18.2.1-341.g4e3182a6.el 2.7 MB/s | 371 kB 00:00 2024-01-24T15:29:51.738 INFO:teuthology.orchestra.run.smithi160.stdout:(33/145): ceph-prometheus-alerts-18.2.1-341.g4e 174 kB/s | 15 kB 00:00 2024-01-24T15:29:51.847 INFO:teuthology.orchestra.run.smithi160.stdout:(34/145): ceph-volume-18.2.1-341.g4e3182a6.el8. 2.4 MB/s | 262 kB 00:00 2024-01-24T15:29:51.861 INFO:teuthology.orchestra.run.smithi005.stdout:(22/145): python3-rbd-18.2.1-341.g4e3182a6.el8. 2.5 MB/s | 365 kB 00:00 2024-01-24T15:29:51.937 INFO:teuthology.orchestra.run.smithi005.stdout:(23/145): python3-rgw-18.2.1-341.g4e3182a6.el8. 1.4 MB/s | 107 kB 00:00 2024-01-24T15:29:51.938 INFO:teuthology.orchestra.run.smithi160.stdout:(35/145): cephadm-18.2.1-341.g4e3182a6.el8.noar 1.8 MB/s | 171 kB 00:00 2024-01-24T15:29:52.013 INFO:teuthology.orchestra.run.smithi005.stdout:(24/145): rbd-fuse-18.2.1-341.g4e3182a6.el8.x86 1.2 MB/s | 94 kB 00:00 2024-01-24T15:29:52.022 INFO:teuthology.orchestra.run.smithi160.stdout:(36/145): cephfs-top-18.2.1-341.g4e3182a6.el8.n 215 kB/s | 18 kB 00:00 2024-01-24T15:29:52.137 INFO:teuthology.orchestra.run.smithi204.stdout:(30/145): ceph-mgr-dashboard-18.2.1-341.g4e3182 1.2 MB/s | 1.8 MB 00:01 2024-01-24T15:29:52.156 INFO:teuthology.orchestra.run.smithi160.stdout:(37/145): gperftools-libs-2.7-9.el8.x86_64.rpm 2.3 MB/s | 306 kB 00:00 2024-01-24T15:29:52.189 INFO:teuthology.orchestra.run.smithi160.stdout:(38/145): liboath-2.6.2-3.el8.x86_64.rpm 1.7 MB/s | 59 kB 00:00 2024-01-24T15:29:52.231 INFO:teuthology.orchestra.run.smithi160.stdout:(39/145): libunwind-1.3.1-3.el8.x86_64.rpm 1.8 MB/s | 75 kB 00:00 2024-01-24T15:29:52.290 INFO:teuthology.orchestra.run.smithi160.stdout:(40/145): python3-asyncssh-2.7.0-2.el8.noarch.r 8.0 MB/s | 476 kB 00:00 2024-01-24T15:29:52.323 INFO:teuthology.orchestra.run.smithi160.stdout:(41/145): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.3 MB/s | 44 kB 00:00 2024-01-24T15:29:52.366 INFO:teuthology.orchestra.run.smithi160.stdout:(42/145): python3-beautifulsoup4-4.6.3-2.el8.1. 4.4 MB/s | 185 kB 00:00 2024-01-24T15:29:52.387 INFO:teuthology.orchestra.run.smithi204.stdout:(31/145): ceph-mgr-modules-core-18.2.1-341.g4e3 971 kB/s | 242 kB 00:00 2024-01-24T15:29:52.399 INFO:teuthology.orchestra.run.smithi160.stdout:(43/145): python3-cachetools-3.1.1-4.el8.noarch 993 kB/s | 33 kB 00:00 2024-01-24T15:29:52.433 INFO:teuthology.orchestra.run.smithi160.stdout:(44/145): python3-certifi-2018.10.15-7.el8.noar 490 kB/s | 16 kB 00:00 2024-01-24T15:29:52.475 INFO:teuthology.orchestra.run.smithi160.stdout:(45/145): python3-cheroot-8.5.2-1.el8.noarch.rp 4.0 MB/s | 173 kB 00:00 2024-01-24T15:29:52.479 INFO:teuthology.orchestra.run.smithi204.stdout:(32/145): ceph-mgr-rook-18.2.1-341.g4e3182a6.el 551 kB/s | 50 kB 00:00 2024-01-24T15:29:52.559 INFO:teuthology.orchestra.run.smithi160.stdout:(46/145): python3-cherrypy-18.4.0-1.el8.noarch. 4.5 MB/s | 384 kB 00:00 2024-01-24T15:29:52.579 INFO:teuthology.orchestra.run.smithi204.stdout:(33/145): ceph-prometheus-alerts-18.2.1-341.g4e 145 kB/s | 15 kB 00:00 2024-01-24T15:29:52.592 INFO:teuthology.orchestra.run.smithi160.stdout:(47/145): python3-google-auth-1.1.1-10.el8.noar 2.4 MB/s | 81 kB 00:00 2024-01-24T15:29:52.634 INFO:teuthology.orchestra.run.smithi160.stdout:(48/145): python3-jaraco-6.2-6.el8.noarch.rpm 265 kB/s | 11 kB 00:00 2024-01-24T15:29:52.654 INFO:teuthology.orchestra.run.smithi005.stdout:(25/145): rbd-mirror-18.2.1-341.g4e3182a6.el8.x 5.4 MB/s | 3.4 MB 00:00 2024-01-24T15:29:52.676 INFO:teuthology.orchestra.run.smithi160.stdout:(49/145): python3-jaraco-functools-2.0-4.el8.no 423 kB/s | 18 kB 00:00 2024-01-24T15:29:52.729 INFO:teuthology.orchestra.run.smithi005.stdout:(26/145): rbd-nbd-18.2.1-341.g4e3182a6.el8.x86_ 2.4 MB/s | 181 kB 00:00 2024-01-24T15:29:52.785 INFO:teuthology.orchestra.run.smithi160.stdout:(50/145): python3-kubernetes-11.0.0-6.el8.noarc 11 MB/s | 1.2 MB 00:00 2024-01-24T15:29:52.796 INFO:teuthology.orchestra.run.smithi204.stdout:(34/145): ceph-volume-18.2.1-341.g4e3182a6.el8. 1.2 MB/s | 262 kB 00:00 2024-01-24T15:29:52.796 INFO:teuthology.orchestra.run.smithi005.stdout:(27/145): ceph-grafana-dashboards-18.2.1-341.g4 346 kB/s | 23 kB 00:00 2024-01-24T15:29:52.826 INFO:teuthology.orchestra.run.smithi160.stdout:(51/145): python3-logutils-0.3.5-11.el8.noarch. 1.1 MB/s | 49 kB 00:00 2024-01-24T15:29:52.869 INFO:teuthology.orchestra.run.smithi160.stdout:(52/145): python3-more-itertools-7.2.0-3.el8.no 1.4 MB/s | 59 kB 00:00 2024-01-24T15:29:52.871 INFO:teuthology.orchestra.run.smithi005.stdout:(28/145): ceph-mgr-cephadm-18.2.1-341.g4e3182a6 1.7 MB/s | 132 kB 00:00 2024-01-24T15:29:52.911 INFO:teuthology.orchestra.run.smithi160.stdout:(53/145): python3-natsort-7.1.1-2.el8.noarch.rp 1.4 MB/s | 60 kB 00:00 2024-01-24T15:29:52.955 INFO:teuthology.orchestra.run.smithi204.stdout:(35/145): ceph-mgr-diskprediction-local-18.2.1- 3.9 MB/s | 7.4 MB 00:01 2024-01-24T15:29:52.961 INFO:teuthology.orchestra.run.smithi160.stdout:(54/145): python3-pecan-1.3.2-9.el8.noarch.rpm 5.6 MB/s | 283 kB 00:00 2024-01-24T15:29:52.980 INFO:teuthology.orchestra.run.smithi204.stdout:(36/145): cephadm-18.2.1-341.g4e3182a6.el8.noar 930 kB/s | 171 kB 00:00 2024-01-24T15:29:53.003 INFO:teuthology.orchestra.run.smithi160.stdout:(55/145): python3-portend-2.6-1.el8.noarch.rpm 374 kB/s | 16 kB 00:00 2024-01-24T15:29:53.045 INFO:teuthology.orchestra.run.smithi160.stdout:(56/145): python3-repoze-lru-0.7-6.el8.noarch.r 802 kB/s | 34 kB 00:00 2024-01-24T15:29:53.087 INFO:teuthology.orchestra.run.smithi160.stdout:(57/145): python3-routes-2.4.1-12.el8.noarch.rp 4.6 MB/s | 196 kB 00:00 2024-01-24T15:29:53.105 INFO:teuthology.orchestra.run.smithi005.stdout:(29/145): ceph-mgr-dashboard-18.2.1-341.g4e3182 7.5 MB/s | 1.8 MB 00:00 2024-01-24T15:29:53.121 INFO:teuthology.orchestra.run.smithi160.stdout:(58/145): python3-rsa-4.9-2.el8.noarch.rpm 1.9 MB/s | 64 kB 00:00 2024-01-24T15:29:53.162 INFO:teuthology.orchestra.run.smithi160.stdout:(59/145): python3-simplegeneric-0.8.1-17.el8.no 451 kB/s | 19 kB 00:00 2024-01-24T15:29:53.205 INFO:teuthology.orchestra.run.smithi160.stdout:(60/145): python3-singledispatch-3.4.0.3-18.el8 574 kB/s | 24 kB 00:00 2024-01-24T15:29:53.263 INFO:teuthology.orchestra.run.smithi160.stdout:(61/145): python3-tempora-1.14.1-5.el8.noarch.r 501 kB/s | 29 kB 00:00 2024-01-24T15:29:53.305 INFO:teuthology.orchestra.run.smithi160.stdout:(62/145): python3-trustme-0.6.0-4.el8.noarch.rp 661 kB/s | 27 kB 00:00 2024-01-24T15:29:53.347 INFO:teuthology.orchestra.run.smithi160.stdout:(63/145): python3-waitress-1.4.3-1.el8.noarch.r 6.0 MB/s | 255 kB 00:00 2024-01-24T15:29:53.389 INFO:teuthology.orchestra.run.smithi160.stdout:(64/145): python3-webob-1.8.5-1.el8.1.noarch.rp 5.9 MB/s | 251 kB 00:00 2024-01-24T15:29:53.431 INFO:teuthology.orchestra.run.smithi160.stdout:(65/145): python3-websocket-client-0.56.0-5.el8 1.4 MB/s | 61 kB 00:00 2024-01-24T15:29:53.447 INFO:teuthology.orchestra.run.smithi204.stdout:(37/145): ceph-test-18.2.1-341.g4e3182a6.el8.x8 5.4 MB/s | 47 MB 00:08 2024-01-24T15:29:53.464 INFO:teuthology.orchestra.run.smithi204.stdout:(38/145): cephfs-top-18.2.1-341.g4e3182a6.el8.n 35 kB/s | 18 kB 00:00 2024-01-24T15:29:53.474 INFO:teuthology.orchestra.run.smithi160.stdout:(66/145): python3-webtest-2.0.33-1.el8.noarch.r 2.0 MB/s | 85 kB 00:00 2024-01-24T15:29:53.557 INFO:teuthology.orchestra.run.smithi160.stdout:(67/145): ceph-mgr-diskprediction-local-18.2.1- 3.2 MB/s | 7.4 MB 00:02 2024-01-24T15:29:53.582 INFO:teuthology.orchestra.run.smithi160.stdout:(68/145): python3-zc-lockfile-2.0-2.el8.noarch. 211 kB/s | 23 kB 00:00 2024-01-24T15:29:53.616 INFO:teuthology.orchestra.run.smithi160.stdout:(69/145): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.0 MB/s | 70 kB 00:00 2024-01-24T15:29:53.681 INFO:teuthology.orchestra.run.smithi005.stdout:(30/145): ceph-osd-18.2.1-341.g4e3182a6.el8.x86 2.2 MB/s | 18 MB 00:07 2024-01-24T15:29:53.789 INFO:teuthology.orchestra.run.smithi204.stdout:(39/145): liboath-2.6.2-3.el8.x86_64.rpm 172 kB/s | 59 kB 00:00 2024-01-24T15:29:53.790 INFO:teuthology.orchestra.run.smithi005.stdout:(31/145): ceph-mgr-modules-core-18.2.1-341.g4e3 2.2 MB/s | 242 kB 00:00 2024-01-24T15:29:53.848 INFO:teuthology.orchestra.run.smithi005.stdout:(32/145): ceph-mgr-rook-18.2.1-341.g4e3182a6.el 868 kB/s | 50 kB 00:00 2024-01-24T15:29:53.848 INFO:teuthology.orchestra.run.smithi204.stdout:(40/145): libunwind-1.3.1-3.el8.x86_64.rpm 196 kB/s | 75 kB 00:00 2024-01-24T15:29:53.981 INFO:teuthology.orchestra.run.smithi204.stdout:(41/145): gperftools-libs-2.7-9.el8.x86_64.rpm 306 kB/s | 306 kB 00:01 2024-01-24T15:29:53.984 INFO:teuthology.orchestra.run.smithi005.stdout:(33/145): ceph-mgr-diskprediction-local-18.2.1- 8.4 MB/s | 7.4 MB 00:00 2024-01-24T15:29:54.007 INFO:teuthology.orchestra.run.smithi204.stdout:(42/145): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 275 kB/s | 44 kB 00:00 2024-01-24T15:29:54.016 INFO:teuthology.orchestra.run.smithi005.stdout:(34/145): ceph-prometheus-alerts-18.2.1-341.g4e 87 kB/s | 15 kB 00:00 2024-01-24T15:29:54.066 INFO:teuthology.orchestra.run.smithi005.stdout:(35/145): cephadm-18.2.1-341.g4e3182a6.el8.noar 3.3 MB/s | 171 kB 00:00 2024-01-24T15:29:54.091 INFO:teuthology.orchestra.run.smithi005.stdout:(36/145): ceph-volume-18.2.1-341.g4e3182a6.el8. 2.4 MB/s | 262 kB 00:00 2024-01-24T15:29:54.107 INFO:teuthology.orchestra.run.smithi204.stdout:(43/145): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2024-01-24T15:29:54.116 INFO:teuthology.orchestra.run.smithi005.stdout:(37/145): cephfs-top-18.2.1-341.g4e3182a6.el8.n 357 kB/s | 18 kB 00:00 2024-01-24T15:29:54.132 INFO:teuthology.orchestra.run.smithi204.stdout:(44/145): python3-cachetools-3.1.1-4.el8.noarch 263 kB/s | 33 kB 00:00 2024-01-24T15:29:54.141 INFO:teuthology.orchestra.run.smithi160.stdout:(70/145): ceph-test-18.2.1-341.g4e3182a6.el8.x8 5.4 MB/s | 47 MB 00:08 2024-01-24T15:29:54.158 INFO:teuthology.orchestra.run.smithi204.stdout:(45/145): python3-asyncssh-2.7.0-2.el8.noarch.r 1.3 MB/s | 476 kB 00:00 2024-01-24T15:29:54.166 INFO:teuthology.orchestra.run.smithi160.stdout:(71/145): libverto-devel-0.3.0-5.el8.x86_64.rpm 32 kB/s | 18 kB 00:00 2024-01-24T15:29:54.225 INFO:teuthology.orchestra.run.smithi160.stdout:(72/145): thrift-0.13.0-2.el8.x86_64.rpm 2.6 MB/s | 1.7 MB 00:00 2024-01-24T15:29:54.300 INFO:teuthology.orchestra.run.smithi160.stdout:(73/145): python3-oauthlib-2.1.0-1.el8.noarch.r 1.2 MB/s | 155 kB 00:00 2024-01-24T15:29:54.342 INFO:teuthology.orchestra.run.smithi160.stdout:(74/145): python3-jwt-1.6.1-2.el8.noarch.rpm 213 kB/s | 43 kB 00:00 2024-01-24T15:29:54.349 INFO:teuthology.orchestra.run.smithi204.stdout:(46/145): python3-certifi-2018.10.15-7.el8.noar 67 kB/s | 16 kB 00:00 2024-01-24T15:29:54.367 INFO:teuthology.orchestra.run.smithi160.stdout:(75/145): python3-pycparser-2.14-14.el8.noarch. 768 kB/s | 109 kB 00:00 2024-01-24T15:29:54.384 INFO:teuthology.orchestra.run.smithi160.stdout:(76/145): python3-requests-oauthlib-1.0.0-1.el8 508 kB/s | 43 kB 00:00 2024-01-24T15:29:54.441 INFO:teuthology.orchestra.run.smithi005.stdout:(38/145): liboath-2.6.2-3.el8.x86_64.rpm 181 kB/s | 59 kB 00:00 2024-01-24T15:29:54.485 INFO:teuthology.orchestra.run.smithi160.stdout:(77/145): libzstd-devel-1.4.4-1.el8.x86_64.rpm 376 kB/s | 44 kB 00:00 2024-01-24T15:29:54.510 INFO:teuthology.orchestra.run.smithi160.stdout:(78/145): libaio-devel-0.3.112-1.el8.x86_64.rpm 112 kB/s | 19 kB 00:00 2024-01-24T15:29:54.525 INFO:teuthology.orchestra.run.smithi204.stdout:(47/145): python3-cherrypy-18.4.0-1.el8.noarch. 1.0 MB/s | 384 kB 00:00 2024-01-24T15:29:54.544 INFO:teuthology.orchestra.run.smithi160.stdout:(79/145): pcre2-devel-10.32-2.el8.x86_64.rpm 3.7 MB/s | 605 kB 00:00 2024-01-24T15:29:54.550 INFO:teuthology.orchestra.run.smithi204.stdout:(48/145): python3-cheroot-8.5.2-1.el8.noarch.rp 413 kB/s | 173 kB 00:00 2024-01-24T15:29:54.575 INFO:teuthology.orchestra.run.smithi204.stdout:(49/145): python3-google-auth-1.1.1-10.el8.noar 360 kB/s | 81 kB 00:00 2024-01-24T15:29:54.594 INFO:teuthology.orchestra.run.smithi160.stdout:(80/145): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.6 MB/s | 220 kB 00:00 2024-01-24T15:29:54.626 INFO:teuthology.orchestra.run.smithi204.stdout:(50/145): python3-jaraco-6.2-6.el8.noarch.rpm 110 kB/s | 11 kB 00:00 2024-01-24T15:29:54.627 INFO:teuthology.orchestra.run.smithi160.stdout:(81/145): libselinux-devel-2.9-5.el8.x86_64.rpm 2.3 MB/s | 200 kB 00:00 2024-01-24T15:29:54.651 INFO:teuthology.orchestra.run.smithi204.stdout:(51/145): python3-jaraco-functools-2.0-4.el8.no 175 kB/s | 18 kB 00:00 2024-01-24T15:29:54.653 INFO:teuthology.orchestra.run.smithi160.stdout:(82/145): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.3 MB/s | 229 kB 00:00 2024-01-24T15:29:54.700 INFO:teuthology.orchestra.run.smithi005.stdout:(39/145): gperftools-libs-2.7-9.el8.x86_64.rpm 503 kB/s | 306 kB 00:00 2024-01-24T15:29:54.703 INFO:teuthology.orchestra.run.smithi160.stdout:(83/145): keyutils-libs-devel-1.5.10-9.el8.x86_ 443 kB/s | 48 kB 00:00 2024-01-24T15:29:54.725 INFO:teuthology.orchestra.run.smithi005.stdout:(40/145): libunwind-1.3.1-3.el8.x86_64.rpm 265 kB/s | 75 kB 00:00 2024-01-24T15:29:54.726 INFO:teuthology.orchestra.run.smithi204.stdout:(52/145): python3-logutils-0.3.5-11.el8.noarch. 487 kB/s | 49 kB 00:00 2024-01-24T15:29:54.768 INFO:teuthology.orchestra.run.smithi204.stdout:(53/145): python3-more-itertools-7.2.0-3.el8.no 504 kB/s | 59 kB 00:00 2024-01-24T15:29:54.825 INFO:teuthology.orchestra.run.smithi005.stdout:(41/145): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 436 kB/s | 44 kB 00:00 2024-01-24T15:29:54.835 INFO:teuthology.orchestra.run.smithi204.stdout:(54/145): python3-natsort-7.1.1-2.el8.noarch.rp 556 kB/s | 60 kB 00:00 2024-01-24T15:29:54.902 INFO:teuthology.orchestra.run.smithi204.stdout:(55/145): python3-kubernetes-11.0.0-6.el8.noarc 3.6 MB/s | 1.2 MB 00:00 2024-01-24T15:29:54.917 INFO:teuthology.orchestra.run.smithi005.stdout:(42/145): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2024-01-24T15:29:54.936 INFO:teuthology.orchestra.run.smithi204.stdout:(56/145): python3-portend-2.6-1.el8.noarch.rpm 156 kB/s | 16 kB 00:00 2024-01-24T15:29:54.978 INFO:teuthology.orchestra.run.smithi204.stdout:(57/145): python3-pecan-1.3.2-9.el8.noarch.rpm 1.3 MB/s | 283 kB 00:00 2024-01-24T15:29:55.003 INFO:teuthology.orchestra.run.smithi204.stdout:(58/145): python3-repoze-lru-0.7-6.el8.noarch.r 334 kB/s | 34 kB 00:00 2024-01-24T15:29:55.018 INFO:teuthology.orchestra.run.smithi005.stdout:(43/145): python3-beautifulsoup4-4.6.3-2.el8.1. 965 kB/s | 185 kB 00:00 2024-01-24T15:29:55.043 INFO:teuthology.orchestra.run.smithi005.stdout:(44/145): python3-cachetools-3.1.1-4.el8.noarch 264 kB/s | 33 kB 00:00 2024-01-24T15:29:55.054 INFO:teuthology.orchestra.run.smithi204.stdout:(59/145): python3-routes-2.4.1-12.el8.noarch.rp 1.6 MB/s | 196 kB 00:00 2024-01-24T15:29:55.079 INFO:teuthology.orchestra.run.smithi160.stdout:(84/145): libsepol-devel-2.9-3.el8.x86_64.rpm 193 kB/s | 87 kB 00:00 2024-01-24T15:29:55.079 INFO:teuthology.orchestra.run.smithi204.stdout:(60/145): python3-rsa-4.9-2.el8.noarch.rpm 639 kB/s | 64 kB 00:00 2024-01-24T15:29:55.104 INFO:teuthology.orchestra.run.smithi160.stdout:(85/145): libcom_err-devel-1.45.6-4.el8.x86_64. 96 kB/s | 39 kB 00:00 2024-01-24T15:29:55.104 INFO:teuthology.orchestra.run.smithi204.stdout:(61/145): python3-simplegeneric-0.8.1-17.el8.no 186 kB/s | 19 kB 00:00 2024-01-24T15:29:55.118 INFO:teuthology.orchestra.run.smithi005.stdout:(45/145): python3-certifi-2018.10.15-7.el8.noar 163 kB/s | 16 kB 00:00 2024-01-24T15:29:55.129 INFO:teuthology.orchestra.run.smithi160.stdout:(86/145): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 121 kB/s | 58 kB 00:00 2024-01-24T15:29:55.152 INFO:teuthology.orchestra.run.smithi005.stdout:(46/145): python3-cheroot-8.5.2-1.el8.noarch.rp 1.5 MB/s | 173 kB 00:00 2024-01-24T15:29:55.154 INFO:teuthology.orchestra.run.smithi204.stdout:(62/145): python3-singledispatch-3.4.0.3-18.el8 238 kB/s | 24 kB 00:00 2024-01-24T15:29:55.180 INFO:teuthology.orchestra.run.smithi204.stdout:(63/145): python3-tempora-1.14.1-5.el8.noarch.r 291 kB/s | 29 kB 00:00 2024-01-24T15:29:55.188 INFO:teuthology.orchestra.run.smithi160.stdout:(87/145): fuse-2.9.7-17.el8.x86_64.rpm 766 kB/s | 83 kB 00:00 2024-01-24T15:29:55.205 INFO:teuthology.orchestra.run.smithi204.stdout:(64/145): python3-trustme-0.6.0-4.el8.noarch.rp 274 kB/s | 27 kB 00:00 2024-01-24T15:29:55.246 INFO:teuthology.orchestra.run.smithi160.stdout:(88/145): libgfortran-8.5.0-20.el8.x86_64.rpm 4.4 MB/s | 645 kB 00:00 2024-01-24T15:29:55.272 INFO:teuthology.orchestra.run.smithi160.stdout:(89/145): libuuid-devel-2.32.1-43.el8.x86_64.rp 1.2 MB/s | 100 kB 00:00 2024-01-24T15:29:55.277 INFO:teuthology.orchestra.run.smithi005.stdout:(47/145): python3-google-auth-1.1.1-10.el8.noar 651 kB/s | 81 kB 00:00 2024-01-24T15:29:55.280 INFO:teuthology.orchestra.run.smithi204.stdout:(65/145): python3-waitress-1.4.3-1.el8.noarch.r 2.0 MB/s | 255 kB 00:00 2024-01-24T15:29:55.297 INFO:teuthology.orchestra.run.smithi160.stdout:(90/145): libquadmath-8.5.0-20.el8.x86_64.rpm 1.0 MB/s | 172 kB 00:00 2024-01-24T15:29:55.303 INFO:teuthology.orchestra.run.smithi005.stdout:(48/145): python3-cherrypy-18.4.0-1.el8.noarch. 2.0 MB/s | 384 kB 00:00 2024-01-24T15:29:55.306 INFO:teuthology.orchestra.run.smithi204.stdout:(66/145): python3-websocket-client-0.56.0-5.el8 612 kB/s | 61 kB 00:00 2024-01-24T15:29:55.364 INFO:teuthology.orchestra.run.smithi160.stdout:(91/145): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.0 MB/s | 238 kB 00:00 2024-01-24T15:29:55.364 INFO:teuthology.orchestra.run.smithi204.stdout:(67/145): python3-webob-1.8.5-1.el8.1.noarch.rp 1.3 MB/s | 251 kB 00:00 2024-01-24T15:29:55.386 INFO:teuthology.orchestra.run.smithi005.stdout:(49/145): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2024-01-24T15:29:55.389 INFO:teuthology.orchestra.run.smithi160.stdout:(92/145): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 793 kB/s | 73 kB 00:00 2024-01-24T15:29:55.389 INFO:teuthology.orchestra.run.smithi204.stdout:(68/145): python3-webtest-2.0.33-1.el8.noarch.r 787 kB/s | 85 kB 00:00 2024-01-24T15:29:55.415 INFO:teuthology.orchestra.run.smithi204.stdout:(69/145): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2024-01-24T15:29:55.420 INFO:teuthology.orchestra.run.smithi005.stdout:(50/145): python3-jaraco-functools-2.0-4.el8.no 151 kB/s | 18 kB 00:00 2024-01-24T15:29:55.422 INFO:teuthology.orchestra.run.smithi160.stdout:(93/145): python3-cryptography-3.2.1-6.el8.x86_ 3.6 MB/s | 559 kB 00:00 2024-01-24T15:29:55.431 INFO:teuthology.orchestra.run.smithi204.stdout:(70/145): python3-zc-lockfile-2.0-2.el8.noarch. 183 kB/s | 23 kB 00:00 2024-01-24T15:29:55.507 INFO:teuthology.orchestra.run.smithi160.stdout:(94/145): elfutils-libelf-devel-0.189-3.el8.x86 434 kB/s | 62 kB 00:00 2024-01-24T15:29:55.540 INFO:teuthology.orchestra.run.smithi160.stdout:(95/145): librabbitmq-0.9.0-4.el8.x86_64.rpm 312 kB/s | 47 kB 00:00 2024-01-24T15:29:55.554 INFO:teuthology.orchestra.run.smithi005.stdout:(51/145): python3-logutils-0.3.5-11.el8.noarch. 365 kB/s | 49 kB 00:00 2024-01-24T15:29:55.565 INFO:teuthology.orchestra.run.smithi204.stdout:(71/145): python3-jwt-1.6.1-2.el8.noarch.rpm 320 kB/s | 43 kB 00:00 2024-01-24T15:29:55.640 INFO:teuthology.orchestra.run.smithi160.stdout:(96/145): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 2.5 MB/s | 562 kB 00:00 2024-01-24T15:29:55.654 INFO:teuthology.orchestra.run.smithi005.stdout:(52/145): python3-kubernetes-11.0.0-6.el8.noarc 4.4 MB/s | 1.2 MB 00:00 2024-01-24T15:29:55.665 INFO:teuthology.orchestra.run.smithi160.stdout:(97/145): NetworkManager-initscripts-updown-1.4 1.1 MB/s | 144 kB 00:00 2024-01-24T15:29:55.679 INFO:teuthology.orchestra.run.smithi005.stdout:(53/145): python3-more-itertools-7.2.0-3.el8.no 470 kB/s | 59 kB 00:00 2024-01-24T15:29:55.724 INFO:teuthology.orchestra.run.smithi204.stdout:(72/145): thrift-0.13.0-2.el8.x86_64.rpm 4.8 MB/s | 1.7 MB 00:00 2024-01-24T15:29:55.741 INFO:teuthology.orchestra.run.smithi160.stdout:(98/145): openssl-devel-1.1.1k-12.el8_9.x86_64. 9.9 MB/s | 2.3 MB 00:00 2024-01-24T15:29:55.741 INFO:teuthology.orchestra.run.smithi204.stdout:(73/145): libverto-devel-0.3.0-5.el8.x86_64.rpm 55 kB/s | 18 kB 00:00 2024-01-24T15:29:55.763 INFO:teuthology.orchestra.run.smithi005.stdout:(54/145): python3-natsort-7.1.1-2.el8.noarch.rp 556 kB/s | 60 kB 00:00 2024-01-24T15:29:55.766 INFO:teuthology.orchestra.run.smithi160.stdout:(99/145): python3-jsonpointer-1.10-11.el8.noarc 159 kB/s | 20 kB 00:00 2024-01-24T15:29:55.788 INFO:teuthology.orchestra.run.smithi005.stdout:(55/145): python3-pecan-1.3.2-9.el8.noarch.rpm 2.5 MB/s | 283 kB 00:00 2024-01-24T15:29:55.802 INFO:teuthology.orchestra.run.smithi204.stdout:(74/145): python3-oauthlib-2.1.0-1.el8.noarch.r 658 kB/s | 155 kB 00:00 2024-01-24T15:29:55.808 INFO:teuthology.orchestra.run.smithi160.stdout:(100/145): python3-prettytable-0.7.2-14.el8.noa 309 kB/s | 44 kB 00:00 2024-01-24T15:29:55.833 INFO:teuthology.orchestra.run.smithi160.stdout:(101/145): python3-pyasn1-modules-0.3.7-6.el8.n 1.2 MB/s | 110 kB 00:00 2024-01-24T15:29:55.841 INFO:teuthology.orchestra.run.smithi204.stdout:(75/145): python3-requests-oauthlib-1.0.0-1.el8 452 kB/s | 43 kB 00:00 2024-01-24T15:29:55.858 INFO:teuthology.orchestra.run.smithi160.stdout:(102/145): python3-jsonpatch-1.21-2.el8.noarch. 288 kB/s | 27 kB 00:00 2024-01-24T15:29:55.863 INFO:teuthology.orchestra.run.smithi005.stdout:(56/145): python3-portend-2.6-1.el8.noarch.rpm 156 kB/s | 16 kB 00:00 2024-01-24T15:29:55.867 INFO:teuthology.orchestra.run.smithi204.stdout:(76/145): python3-pycparser-2.14-14.el8.noarch. 767 kB/s | 109 kB 00:00 2024-01-24T15:29:55.889 INFO:teuthology.orchestra.run.smithi005.stdout:(57/145): python3-repoze-lru-0.7-6.el8.noarch.r 336 kB/s | 34 kB 00:00 2024-01-24T15:29:55.900 INFO:teuthology.orchestra.run.smithi160.stdout:(103/145): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.3 MB/s | 126 kB 00:00 2024-01-24T15:29:55.909 INFO:teuthology.orchestra.run.smithi204.stdout:(77/145): libaio-devel-0.3.112-1.el8.x86_64.rpm 174 kB/s | 19 kB 00:00 2024-01-24T15:29:55.942 INFO:teuthology.orchestra.run.smithi204.stdout:(78/145): libzstd-devel-1.4.4-1.el8.x86_64.rpm 437 kB/s | 44 kB 00:00 2024-01-24T15:29:55.973 INFO:teuthology.orchestra.run.smithi005.stdout:(58/145): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2024-01-24T15:29:55.984 INFO:teuthology.orchestra.run.smithi160.stdout:(104/145): python3-werkzeug-0.12.2-4.el8.noarch 3.0 MB/s | 457 kB 00:00 2024-01-24T15:29:56.006 INFO:teuthology.orchestra.run.smithi005.stdout:(59/145): python3-rsa-4.9-2.el8.noarch.rpm 548 kB/s | 64 kB 00:00 2024-01-24T15:29:56.009 INFO:teuthology.orchestra.run.smithi204.stdout:(79/145): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.2 MB/s | 229 kB 00:00 2024-01-24T15:29:56.018 INFO:teuthology.orchestra.run.smithi160.stdout:(105/145): flex-2.6.1-9.el8.x86_64.rpm 2.7 MB/s | 320 kB 00:00 2024-01-24T15:29:56.043 INFO:teuthology.orchestra.run.smithi160.stdout:(106/145): bison-3.0.4-10.el8.x86_64.rpm 3.7 MB/s | 688 kB 00:00 2024-01-24T15:29:56.043 INFO:teuthology.orchestra.run.smithi204.stdout:(80/145): pcre2-devel-10.32-2.el8.x86_64.rpm 3.4 MB/s | 605 kB 00:00 2024-01-24T15:29:56.068 INFO:teuthology.orchestra.run.smithi204.stdout:(81/145): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.7 MB/s | 220 kB 00:00 2024-01-24T15:29:56.073 INFO:teuthology.orchestra.run.smithi005.stdout:(60/145): python3-simplegeneric-0.8.1-17.el8.no 187 kB/s | 19 kB 00:00 2024-01-24T15:29:56.101 INFO:teuthology.orchestra.run.smithi160.stdout:(107/145): libtool-2.4.6-25.el8.x86_64.rpm 5.9 MB/s | 709 kB 00:00 2024-01-24T15:29:56.107 INFO:teuthology.orchestra.run.smithi005.stdout:(61/145): python3-singledispatch-3.4.0.3-18.el8 239 kB/s | 24 kB 00:00 2024-01-24T15:29:56.118 INFO:teuthology.orchestra.run.smithi160.stdout:(108/145): python3-markupsafe-0.23-19.el8.x86_6 387 kB/s | 39 kB 00:00 2024-01-24T15:29:56.135 INFO:teuthology.orchestra.run.smithi204.stdout:(82/145): libselinux-devel-2.9-5.el8.x86_64.rpm 1.6 MB/s | 200 kB 00:00 2024-01-24T15:29:56.174 INFO:teuthology.orchestra.run.smithi005.stdout:(62/145): python3-tempora-1.14.1-5.el8.noarch.r 291 kB/s | 29 kB 00:00 2024-01-24T15:29:56.185 INFO:teuthology.orchestra.run.smithi204.stdout:(83/145): keyutils-libs-devel-1.5.10-9.el8.x86_ 338 kB/s | 48 kB 00:00 2024-01-24T15:29:56.207 INFO:teuthology.orchestra.run.smithi005.stdout:(63/145): python3-trustme-0.6.0-4.el8.noarch.rp 275 kB/s | 27 kB 00:00 2024-01-24T15:29:56.210 INFO:teuthology.orchestra.run.smithi160.stdout:(109/145): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.5 MB/s | 259 kB 00:00 2024-01-24T15:29:56.210 INFO:teuthology.orchestra.run.smithi204.stdout:(84/145): libsepol-devel-2.9-3.el8.x86_64.rpm 612 kB/s | 87 kB 00:00 2024-01-24T15:29:56.236 INFO:teuthology.orchestra.run.smithi160.stdout:(110/145): uuid-1.6.2-43.el8.x86_64.rpm 547 kB/s | 64 kB 00:00 2024-01-24T15:29:56.244 INFO:teuthology.orchestra.run.smithi204.stdout:(85/145): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 530 kB/s | 58 kB 00:00 2024-01-24T15:29:56.261 INFO:teuthology.orchestra.run.smithi160.stdout:(111/145): oniguruma-6.8.2-2.el8.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2024-01-24T15:29:56.291 INFO:teuthology.orchestra.run.smithi005.stdout:(64/145): python3-waitress-1.4.3-1.el8.noarch.r 2.1 MB/s | 255 kB 00:00 2024-01-24T15:29:56.328 INFO:teuthology.orchestra.run.smithi204.stdout:(86/145): libcom_err-devel-1.45.6-4.el8.x86_64. 271 kB/s | 39 kB 00:00 2024-01-24T15:29:56.335 INFO:teuthology.orchestra.run.smithi005.stdout:(65/145): python3-webob-1.8.5-1.el8.1.noarch.rp 2.0 MB/s | 251 kB 00:00 2024-01-24T15:29:56.344 INFO:teuthology.orchestra.run.smithi160.stdout:(112/145): python3-pyOpenSSL-19.0.0-1.el8.noarc 774 kB/s | 103 kB 00:00 2024-01-24T15:29:56.353 INFO:teuthology.orchestra.run.smithi204.stdout:(87/145): fuse-2.9.7-17.el8.x86_64.rpm 583 kB/s | 83 kB 00:00 2024-01-24T15:29:56.404 INFO:teuthology.orchestra.run.smithi204.stdout:(88/145): libquadmath-8.5.0-20.el8.x86_64.rpm 2.2 MB/s | 172 kB 00:00 2024-01-24T15:29:56.416 INFO:teuthology.orchestra.run.smithi005.stdout:(66/145): python3-websocket-client-0.56.0-5.el8 489 kB/s | 61 kB 00:00 2024-01-24T15:29:56.420 INFO:teuthology.orchestra.run.smithi160.stdout:(113/145): python3-jinja2-2.10.1-3.el8.noarch.r 3.3 MB/s | 538 kB 00:00 2024-01-24T15:29:56.429 INFO:teuthology.orchestra.run.smithi204.stdout:(89/145): libuuid-devel-2.32.1-43.el8.x86_64.rp 1.3 MB/s | 100 kB 00:00 2024-01-24T15:29:56.442 INFO:teuthology.orchestra.run.smithi005.stdout:(67/145): python3-webtest-2.0.33-1.el8.noarch.r 788 kB/s | 85 kB 00:00 2024-01-24T15:29:56.513 INFO:teuthology.orchestra.run.smithi204.stdout:(90/145): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.1 MB/s | 238 kB 00:00 2024-01-24T15:29:56.517 INFO:teuthology.orchestra.run.smithi005.stdout:(68/145): python3-zc-lockfile-2.0-2.el8.noarch. 229 kB/s | 23 kB 00:00 2024-01-24T15:29:56.542 INFO:teuthology.orchestra.run.smithi005.stdout:(69/145): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 70 kB 00:00 2024-01-24T15:29:56.546 INFO:teuthology.orchestra.run.smithi204.stdout:(91/145): libgfortran-8.5.0-20.el8.x86_64.rpm 2.1 MB/s | 645 kB 00:00 2024-01-24T15:29:56.580 INFO:teuthology.orchestra.run.smithi160.stdout:(114/145): python3-babel-2.5.1-7.el8.noarch.rpm 14 MB/s | 4.8 MB 00:00 2024-01-24T15:29:56.605 INFO:teuthology.orchestra.run.smithi204.stdout:(92/145): python3-cryptography-3.2.1-6.el8.x86_ 3.1 MB/s | 559 kB 00:00 2024-01-24T15:29:56.614 INFO:teuthology.orchestra.run.smithi160.stdout:(115/145): socat-1.7.4.1-1.el8.x86_64.rpm 1.6 MB/s | 323 kB 00:00 2024-01-24T15:29:56.647 INFO:teuthology.orchestra.run.smithi204.stdout:(93/145): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 543 kB/s | 73 kB 00:00 2024-01-24T15:29:56.681 INFO:teuthology.orchestra.run.smithi160.stdout:(116/145): python3-numpy-1.14.3-10.el8.x86_64.r 11 MB/s | 3.7 MB 00:00 2024-01-24T15:29:56.701 INFO:teuthology.orchestra.run.smithi005.stdout:(70/145): libverto-devel-0.3.0-5.el8.x86_64.rpm 113 kB/s | 18 kB 00:00 2024-01-24T15:29:56.706 INFO:teuthology.orchestra.run.smithi160.stdout:(117/145): python3-numpy-f2py-1.14.3-10.el8.x86 1.8 MB/s | 225 kB 00:00 2024-01-24T15:29:56.714 INFO:teuthology.orchestra.run.smithi204.stdout:(94/145): elfutils-libelf-devel-0.189-3.el8.x86 369 kB/s | 62 kB 00:00 2024-01-24T15:29:56.757 INFO:teuthology.orchestra.run.smithi160.stdout:(118/145): librdkafka-0.11.4-3.el8.x86_64.rpm 2.4 MB/s | 354 kB 00:00 2024-01-24T15:29:56.763 INFO:teuthology.orchestra.run.smithi204.stdout:(95/145): librabbitmq-0.9.0-4.el8.x86_64.rpm 298 kB/s | 47 kB 00:00 2024-01-24T15:29:56.793 INFO:teuthology.orchestra.run.smithi005.stdout:(71/145): thrift-0.13.0-2.el8.x86_64.rpm 4.9 MB/s | 1.7 MB 00:00 2024-01-24T15:29:56.856 INFO:teuthology.orchestra.run.smithi204.stdout:(96/145): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 2.6 MB/s | 562 kB 00:00 2024-01-24T15:29:56.888 INFO:teuthology.orchestra.run.smithi160.stdout:(119/145): python3-mako-1.0.6-14.el8.noarch.rpm 865 kB/s | 157 kB 00:00 2024-01-24T15:29:56.898 INFO:teuthology.orchestra.run.smithi204.stdout:(97/145): NetworkManager-initscripts-updown-1.4 1.0 MB/s | 144 kB 00:00 2024-01-24T15:29:56.927 INFO:teuthology.orchestra.run.smithi005.stdout:(72/145): python3-jwt-1.6.1-2.el8.noarch.rpm 189 kB/s | 43 kB 00:00 2024-01-24T15:29:56.965 INFO:teuthology.orchestra.run.smithi204.stdout:(98/145): openssl-devel-1.1.1k-12.el8_9.x86_64. 9.3 MB/s | 2.3 MB 00:00 2024-01-24T15:29:56.990 INFO:teuthology.orchestra.run.smithi204.stdout:(99/145): python3-jsonpointer-1.10-11.el8.noarc 149 kB/s | 20 kB 00:00 2024-01-24T15:29:56.999 INFO:teuthology.orchestra.run.smithi160.stdout:(120/145): openblas-threads-0.3.15-6.el8.x86_64 16 MB/s | 5.2 MB 00:00 2024-01-24T15:29:57.015 INFO:teuthology.orchestra.run.smithi204.stdout:(100/145): python3-prettytable-0.7.2-14.el8.noa 375 kB/s | 44 kB 00:00 2024-01-24T15:29:57.019 INFO:teuthology.orchestra.run.smithi005.stdout:(73/145): python3-oauthlib-2.1.0-1.el8.noarch.r 688 kB/s | 155 kB 00:00 2024-01-24T15:29:57.049 INFO:teuthology.orchestra.run.smithi204.stdout:(101/145): python3-pyasn1-modules-0.3.7-6.el8.n 1.3 MB/s | 110 kB 00:00 2024-01-24T15:29:57.050 INFO:teuthology.orchestra.run.smithi160.stdout:(121/145): automake-1.16.1-8.el8.noarch.rpm 4.3 MB/s | 714 kB 00:00 2024-01-24T15:29:57.128 INFO:teuthology.orchestra.run.smithi005.stdout:(74/145): python3-pycparser-2.14-14.el8.noarch. 544 kB/s | 109 kB 00:00 2024-01-24T15:29:57.132 INFO:teuthology.orchestra.run.smithi160.stdout:(122/145): openblas-0.3.15-6.el8.x86_64.rpm 13 MB/s | 5.0 MB 00:00 2024-01-24T15:29:57.156 INFO:teuthology.orchestra.run.smithi005.stdout:(75/145): python3-requests-oauthlib-1.0.0-1.el8 319 kB/s | 43 kB 00:00 2024-01-24T15:29:57.157 INFO:teuthology.orchestra.run.smithi160.stdout:(123/145): libpq-13.11-1.el8.x86_64.rpm 1.2 MB/s | 198 kB 00:00 2024-01-24T15:29:57.191 INFO:teuthology.orchestra.run.smithi204.stdout:(102/145): python3-pyasn1-0.3.7-6.el8.noarch.rp 721 kB/s | 126 kB 00:00 2024-01-24T15:29:57.241 INFO:teuthology.orchestra.run.smithi204.stdout:(103/145): python3-jsonpatch-1.21-2.el8.noarch. 106 kB/s | 27 kB 00:00 2024-01-24T15:29:57.266 INFO:teuthology.orchestra.run.smithi160.stdout:(124/145): jq-1.6-7.el8.x86_64.rpm 933 kB/s | 202 kB 00:00 2024-01-24T15:29:57.275 INFO:teuthology.orchestra.run.smithi204.stdout:(104/145): python3-werkzeug-0.12.2-4.el8.noarch 2.0 MB/s | 457 kB 00:00 2024-01-24T15:29:57.278 INFO:teuthology.orchestra.run.smithi005.stdout:(76/145): libaio-devel-0.3.112-1.el8.x86_64.rpm 124 kB/s | 19 kB 00:00 2024-01-24T15:29:57.283 INFO:teuthology.orchestra.run.smithi160.stdout:(125/145): python3-pytz-2017.2-11.el8.noarch.rp 361 kB/s | 54 kB 00:00 2024-01-24T15:29:57.333 INFO:teuthology.orchestra.run.smithi204.stdout:(105/145): flex-2.6.1-9.el8.x86_64.rpm 3.4 MB/s | 320 kB 00:00 2024-01-24T15:29:57.337 INFO:teuthology.orchestra.run.smithi005.stdout:(77/145): libzstd-devel-1.4.4-1.el8.x86_64.rpm 239 kB/s | 44 kB 00:00 2024-01-24T15:29:57.342 INFO:teuthology.orchestra.run.smithi160.stdout:(126/145): postgresql-10.23-3.module+el8.9.0+20 8.2 MB/s | 1.5 MB 00:00 2024-01-24T15:29:57.459 INFO:teuthology.orchestra.run.smithi204.stdout:(106/145): bison-3.0.4-10.el8.x86_64.rpm 2.5 MB/s | 688 kB 00:00 2024-01-24T15:29:57.484 INFO:teuthology.orchestra.run.smithi204.stdout:(107/145): python3-markupsafe-0.23-19.el8.x86_6 258 kB/s | 39 kB 00:00 2024-01-24T15:29:57.518 INFO:teuthology.orchestra.run.smithi204.stdout:(108/145): libtool-2.4.6-25.el8.x86_64.rpm 2.9 MB/s | 709 kB 00:00 2024-01-24T15:29:57.525 INFO:teuthology.orchestra.run.smithi160.stdout:(127/145): postgresql-server-10.23-3.module+el8 21 MB/s | 5.1 MB 00:00 2024-01-24T15:29:57.554 INFO:teuthology.orchestra.run.smithi005.stdout:(78/145): pcre2-devel-10.32-2.el8.x86_64.rpm 2.1 MB/s | 605 kB 00:00 2024-01-24T15:29:57.568 INFO:teuthology.orchestra.run.smithi204.stdout:(109/145): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.3 MB/s | 259 kB 00:00 2024-01-24T15:29:57.593 INFO:teuthology.orchestra.run.smithi204.stdout:(110/145): oniguruma-6.8.2-2.el8.x86_64.rpm 1.7 MB/s | 187 kB 00:00 2024-01-24T15:29:57.599 INFO:teuthology.orchestra.run.smithi160.stdout:(128/145): postgresql-contrib-10.23-3.module+el 2.4 MB/s | 811 kB 00:00 2024-01-24T15:29:57.618 INFO:teuthology.orchestra.run.smithi204.stdout:(111/145): uuid-1.6.2-43.el8.x86_64.rpm 637 kB/s | 64 kB 00:00 2024-01-24T15:29:57.719 INFO:teuthology.orchestra.run.smithi204.stdout:(112/145): python3-pyOpenSSL-19.0.0-1.el8.noarc 688 kB/s | 103 kB 00:00 2024-01-24T15:29:57.752 INFO:teuthology.orchestra.run.smithi204.stdout:(113/145): python3-jinja2-2.10.1-3.el8.noarch.r 3.9 MB/s | 538 kB 00:00 2024-01-24T15:29:57.811 INFO:teuthology.orchestra.run.smithi204.stdout:(114/145): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2024-01-24T15:29:57.893 INFO:teuthology.orchestra.run.smithi160.stdout:(129/145): python3-scipy-1.0.0-21.module+el8.9. 25 MB/s | 14 MB 00:00 2024-01-24T15:29:57.945 INFO:teuthology.orchestra.run.smithi204.stdout:(115/145): python3-numpy-1.14.3-10.el8.x86_64.r 17 MB/s | 3.7 MB 00:00 2024-01-24T15:29:57.996 INFO:teuthology.orchestra.run.smithi005.stdout:(79/145): ceph-test-18.2.1-341.g4e3182a6.el8.x8 4.7 MB/s | 47 MB 00:09 2024-01-24T15:29:58.020 INFO:teuthology.orchestra.run.smithi204.stdout:(116/145): python3-babel-2.5.1-7.el8.noarch.rpm 11 MB/s | 4.8 MB 00:00 2024-01-24T15:29:58.029 INFO:teuthology.orchestra.run.smithi005.stdout:(80/145): pcre2-utf16-10.32-2.el8.x86_64.rpm 331 kB/s | 229 kB 00:00 2024-01-24T15:29:58.048 INFO:teuthology.orchestra.run.smithi204.stdout:(117/145): python3-numpy-f2py-1.14.3-10.el8.x86 963 kB/s | 225 kB 00:00 2024-01-24T15:29:58.051 INFO:teuthology.orchestra.run.smithi160.stdout:(130/145): elfutils-libelf-0.189-3.el8.x86_64.r 1.4 MB/s | 232 kB 00:00 2024-01-24T15:29:58.063 INFO:teuthology.orchestra.run.smithi005.stdout:(81/145): pcre2-utf32-10.32-2.el8.x86_64.rpm 433 kB/s | 220 kB 00:00 2024-01-24T15:29:58.147 INFO:teuthology.orchestra.run.smithi005.stdout:(82/145): keyutils-libs-devel-1.5.10-9.el8.x86_ 444 kB/s | 48 kB 00:00 2024-01-24T15:29:58.185 INFO:teuthology.orchestra.run.smithi160.stdout:(131/145): elfutils-libs-0.189-3.el8.x86_64.rpm 2.2 MB/s | 303 kB 00:00 2024-01-24T15:29:58.204 INFO:teuthology.orchestra.run.smithi204.stdout:(118/145): librdkafka-0.11.4-3.el8.x86_64.rpm 1.3 MB/s | 354 kB 00:00 2024-01-24T15:29:58.239 INFO:teuthology.orchestra.run.smithi005.stdout:(83/145): libselinux-devel-2.9-5.el8.x86_64.rpm 827 kB/s | 200 kB 00:00 2024-01-24T15:29:58.264 INFO:teuthology.orchestra.run.smithi005.stdout:(84/145): libsepol-devel-2.9-3.el8.x86_64.rpm 434 kB/s | 87 kB 00:00 2024-01-24T15:29:58.279 INFO:teuthology.orchestra.run.smithi204.stdout:(119/145): python3-mako-1.0.6-14.el8.noarch.rpm 671 kB/s | 157 kB 00:00 2024-01-24T15:29:58.306 INFO:teuthology.orchestra.run.smithi005.stdout:(85/145): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 363 kB/s | 58 kB 00:00 2024-01-24T15:29:58.326 INFO:teuthology.orchestra.run.smithi160.stdout:(132/145): librbd1-18.2.1-341.g4e3182a6.el8.x86 4.9 MB/s | 3.6 MB 00:00 2024-01-24T15:29:58.356 INFO:teuthology.orchestra.run.smithi005.stdout:(86/145): libcom_err-devel-1.45.6-4.el8.x86_64. 329 kB/s | 39 kB 00:00 2024-01-24T15:29:58.360 INFO:teuthology.orchestra.run.smithi160.stdout:(133/145): libmount-2.32.1-43.el8.x86_64.rpm 1.3 MB/s | 237 kB 00:00 2024-01-24T15:29:58.373 INFO:teuthology.orchestra.run.smithi005.stdout:(87/145): fuse-2.9.7-17.el8.x86_64.rpm 763 kB/s | 83 kB 00:00 2024-01-24T15:29:58.379 INFO:teuthology.orchestra.run.smithi204.stdout:(120/145): openblas-threads-0.3.15-6.el8.x86_64 15 MB/s | 5.2 MB 00:00 2024-01-24T15:29:58.419 INFO:teuthology.orchestra.run.smithi160.stdout:(134/145): librados2-18.2.1-341.g4e3182a6.el8.x 4.1 MB/s | 3.7 MB 00:00 2024-01-24T15:29:58.421 INFO:teuthology.orchestra.run.smithi204.stdout:(121/145): automake-1.16.1-8.el8.noarch.rpm 4.9 MB/s | 714 kB 00:00 2024-01-24T15:29:58.440 INFO:teuthology.orchestra.run.smithi005.stdout:(88/145): libgfortran-8.5.0-20.el8.x86_64.rpm 4.7 MB/s | 645 kB 00:00 2024-01-24T15:29:58.444 INFO:teuthology.orchestra.run.smithi160.stdout:(135/145): libsmartcols-2.32.1-43.el8.x86_64.rp 1.5 MB/s | 179 kB 00:00 2024-01-24T15:29:58.491 INFO:teuthology.orchestra.run.smithi005.stdout:(89/145): libquadmath-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2024-01-24T15:29:58.536 INFO:teuthology.orchestra.run.smithi160.stdout:(136/145): libuuid-2.32.1-43.el8.x86_64.rpm 564 kB/s | 99 kB 00:00 2024-01-24T15:29:58.538 INFO:teuthology.orchestra.run.smithi204.stdout:(122/145): openblas-0.3.15-6.el8.x86_64.rpm 15 MB/s | 5.0 MB 00:00 2024-01-24T15:29:58.553 INFO:teuthology.orchestra.run.smithi160.stdout:(137/145): util-linux-user-2.32.1-43.el8.x86_64 945 kB/s | 103 kB 00:00 2024-01-24T15:29:58.563 INFO:teuthology.orchestra.run.smithi204.stdout:(123/145): libpq-13.11-1.el8.x86_64.rpm 1.1 MB/s | 198 kB 00:00 2024-01-24T15:29:58.607 INFO:teuthology.orchestra.run.smithi005.stdout:(90/145): libuuid-devel-2.32.1-43.el8.x86_64.rp 426 kB/s | 100 kB 00:00 2024-01-24T15:29:58.619 INFO:teuthology.orchestra.run.smithi204.stdout:(124/145): jq-1.6-7.el8.x86_64.rpm 1.0 MB/s | 202 kB 00:00 2024-01-24T15:29:58.628 INFO:teuthology.orchestra.run.smithi160.stdout:(138/145): util-linux-2.32.1-43.el8.x86_64.rpm 12 MB/s | 2.5 MB 00:00 2024-01-24T15:29:58.649 INFO:teuthology.orchestra.run.smithi005.stdout:(91/145): python3-cryptography-3.2.1-6.el8.x86_ 3.4 MB/s | 559 kB 00:00 2024-01-24T15:29:58.670 INFO:teuthology.orchestra.run.smithi160.stdout:(139/145): iproute-6.2.0-5.el8_9.x86_64.rpm 6.2 MB/s | 854 kB 00:00 2024-01-24T15:29:58.683 INFO:teuthology.orchestra.run.smithi005.stdout:(92/145): python3-cffi-1.11.5-6.el8.x86_64.rpm 981 kB/s | 238 kB 00:00 2024-01-24T15:29:58.706 INFO:teuthology.orchestra.run.smithi204.stdout:(125/145): python3-pytz-2017.2-11.el8.noarch.rp 325 kB/s | 54 kB 00:00 2024-01-24T15:29:58.737 INFO:teuthology.orchestra.run.smithi160.stdout:(140/145): libblkid-2.32.1-43.el8.x86_64.rpm 1.2 MB/s | 220 kB 00:00 2024-01-24T15:29:58.758 INFO:teuthology.orchestra.run.smithi005.stdout:(93/145): elfutils-libelf-devel-0.189-3.el8.x86 569 kB/s | 62 kB 00:00 2024-01-24T15:29:58.762 INFO:teuthology.orchestra.run.smithi160.stdout:(141/145): libfdisk-2.32.1-43.el8.x86_64.rpm 1.9 MB/s | 254 kB 00:00 2024-01-24T15:29:58.781 INFO:teuthology.orchestra.run.smithi204.stdout:(126/145): postgresql-10.23-3.module+el8.9.0+20 6.9 MB/s | 1.5 MB 00:00 2024-01-24T15:29:58.804 INFO:teuthology.orchestra.run.smithi160.stdout:(142/145): xfsprogs-5.0.0-12.el8.x86_64.rpm 8.0 MB/s | 1.1 MB 00:00 2024-01-24T15:29:58.823 INFO:teuthology.orchestra.run.smithi204.stdout:(127/145): postgresql-contrib-10.23-3.module+el 3.9 MB/s | 811 kB 00:00 2024-01-24T15:29:58.825 INFO:teuthology.orchestra.run.smithi005.stdout:(94/145): librabbitmq-0.9.0-4.el8.x86_64.rpm 330 kB/s | 47 kB 00:00 2024-01-24T15:29:58.850 INFO:teuthology.orchestra.run.smithi005.stdout:(95/145): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 299 kB/s | 73 kB 00:00 2024-01-24T15:29:58.892 INFO:teuthology.orchestra.run.smithi005.stdout:(96/145): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 4.1 MB/s | 562 kB 00:00 2024-01-24T15:29:58.896 INFO:teuthology.orchestra.run.smithi160.stdout:(143/145): openssl-1.1.1k-12.el8_9.x86_64.rpm 4.4 MB/s | 711 kB 00:00 2024-01-24T15:29:58.918 INFO:teuthology.orchestra.run.smithi005.stdout:(97/145): NetworkManager-initscripts-updown-1.4 2.1 MB/s | 144 kB 00:00 2024-01-24T15:29:58.946 INFO:teuthology.orchestra.run.smithi160.stdout:(144/145): openssl-libs-1.1.1k-12.el8_9.x86_64. 8.0 MB/s | 1.5 MB 00:00 2024-01-24T15:29:58.957 INFO:teuthology.orchestra.run.smithi204.stdout:(128/145): postgresql-server-10.23-3.module+el8 20 MB/s | 5.1 MB 00:00 2024-01-24T15:29:58.996 INFO:teuthology.orchestra.run.smithi160.stdout:(145/145): xfsdump-3.1.8-7.el8_9.x86_64.rpm 1.7 MB/s | 333 kB 00:00 2024-01-24T15:29:58.998 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-01-24T15:29:58.998 INFO:teuthology.orchestra.run.smithi160.stdout:Total 11 MB/s | 212 MB 00:19 2024-01-24T15:29:59.001 INFO:teuthology.orchestra.run.smithi005.stdout:(98/145): python3-jsonpointer-1.10-11.el8.noarc 184 kB/s | 20 kB 00:00 2024-01-24T15:29:59.027 INFO:teuthology.orchestra.run.smithi005.stdout:(99/145): python3-prettytable-0.7.2-14.el8.noar 406 kB/s | 44 kB 00:00 2024-01-24T15:29:59.102 INFO:teuthology.orchestra.run.smithi005.stdout:(100/145): openssl-devel-1.1.1k-12.el8_9.x86_64 8.4 MB/s | 2.3 MB 00:00 2024-01-24T15:29:59.161 INFO:teuthology.orchestra.run.smithi005.stdout:(101/145): python3-pyasn1-modules-0.3.7-6.el8.n 692 kB/s | 110 kB 00:00 2024-01-24T15:29:59.186 INFO:teuthology.orchestra.run.smithi005.stdout:(102/145): python3-jsonpatch-1.21-2.el8.noarch. 167 kB/s | 27 kB 00:00 2024-01-24T15:29:59.220 INFO:teuthology.orchestra.run.smithi005.stdout:(103/145): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.1 MB/s | 126 kB 00:00 2024-01-24T15:29:59.274 INFO:teuthology.orchestra.run.smithi204.stdout:(129/145): python3-scipy-1.0.0-21.module+el8.9. 28 MB/s | 14 MB 00:00 2024-01-24T15:29:59.345 INFO:teuthology.orchestra.run.smithi005.stdout:(104/145): python3-werkzeug-0.12.2-4.el8.noarch 2.4 MB/s | 457 kB 00:00 2024-01-24T15:29:59.379 INFO:teuthology.orchestra.run.smithi005.stdout:(105/145): flex-2.6.1-9.el8.x86_64.rpm 2.0 MB/s | 320 kB 00:00 2024-01-24T15:29:59.416 INFO:teuthology.orchestra.run.smithi204.stdout:(130/145): elfutils-libelf-0.189-3.el8.x86_64.r 1.6 MB/s | 232 kB 00:00 2024-01-24T15:29:59.421 INFO:teuthology.orchestra.run.smithi005.stdout:(106/145): bison-3.0.4-10.el8.x86_64.rpm 2.9 MB/s | 688 kB 00:00 2024-01-24T15:29:59.529 INFO:teuthology.orchestra.run.smithi005.stdout:(107/145): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.3 MB/s | 259 kB 00:00 2024-01-24T15:29:59.571 INFO:teuthology.orchestra.run.smithi005.stdout:(108/145): libtool-2.4.6-25.el8.x86_64.rpm 3.1 MB/s | 709 kB 00:00 2024-01-24T15:29:59.588 INFO:teuthology.orchestra.run.smithi005.stdout:(109/145): python3-markupsafe-0.23-19.el8.x86_6 186 kB/s | 39 kB 00:00 2024-01-24T15:29:59.599 INFO:teuthology.orchestra.run.smithi204.stdout:(131/145): librados2-18.2.1-341.g4e3182a6.el8.x 4.7 MB/s | 3.7 MB 00:00 2024-01-24T15:29:59.655 INFO:teuthology.orchestra.run.smithi005.stdout:(110/145): oniguruma-6.8.2-2.el8.x86_64.rpm 1.5 MB/s | 187 kB 00:00 2024-01-24T15:29:59.689 INFO:teuthology.orchestra.run.smithi005.stdout:(111/145): uuid-1.6.2-43.el8.x86_64.rpm 545 kB/s | 64 kB 00:00 2024-01-24T15:29:59.691 INFO:teuthology.orchestra.run.smithi204.stdout:(132/145): libmount-2.32.1-43.el8.x86_64.rpm 2.5 MB/s | 237 kB 00:00 2024-01-24T15:29:59.725 INFO:teuthology.orchestra.run.smithi204.stdout:(133/145): elfutils-libs-0.189-3.el8.x86_64.rpm 981 kB/s | 303 kB 00:00 2024-01-24T15:29:59.772 INFO:teuthology.orchestra.run.smithi005.stdout:(112/145): python3-pyOpenSSL-19.0.0-1.el8.noarc 562 kB/s | 103 kB 00:00 2024-01-24T15:29:59.864 INFO:teuthology.orchestra.run.smithi005.stdout:(113/145): python3-jinja2-2.10.1-3.el8.noarch.r 3.0 MB/s | 538 kB 00:00 2024-01-24T15:29:59.867 INFO:teuthology.orchestra.run.smithi204.stdout:(134/145): libuuid-2.32.1-43.el8.x86_64.rpm 699 kB/s | 99 kB 00:00 2024-01-24T15:29:59.892 INFO:teuthology.orchestra.run.smithi204.stdout:(135/145): libsmartcols-2.32.1-43.el8.x86_64.rp 896 kB/s | 179 kB 00:00 2024-01-24T15:29:59.948 INFO:teuthology.orchestra.run.smithi005.stdout:(114/145): python3-babel-2.5.1-7.el8.noarch.rpm 16 MB/s | 4.8 MB 00:00 2024-01-24T15:29:59.998 INFO:teuthology.orchestra.run.smithi005.stdout:(115/145): socat-1.7.4.1-1.el8.x86_64.rpm 2.4 MB/s | 323 kB 00:00 2024-01-24T15:30:00.059 INFO:teuthology.orchestra.run.smithi204.stdout:(136/145): util-linux-2.32.1-43.el8.x86_64.rpm 13 MB/s | 2.5 MB 00:00 2024-01-24T15:30:00.090 INFO:teuthology.orchestra.run.smithi005.stdout:(116/145): python3-numpy-1.14.3-10.el8.x86_64.r 12 MB/s | 3.7 MB 00:00 2024-01-24T15:30:00.093 INFO:teuthology.orchestra.run.smithi204.stdout:(137/145): util-linux-user-2.32.1-43.el8.x86_64 512 kB/s | 103 kB 00:00 2024-01-24T15:30:00.135 INFO:teuthology.orchestra.run.smithi005.stdout:(117/145): python3-numpy-f2py-1.14.3-10.el8.x86 1.2 MB/s | 225 kB 00:00 2024-01-24T15:30:00.166 INFO:teuthology.orchestra.run.smithi005.stdout:(118/145): librdkafka-0.11.4-3.el8.x86_64.rpm 2.1 MB/s | 354 kB 00:00 2024-01-24T15:30:00.285 INFO:teuthology.orchestra.run.smithi204.stdout:(138/145): iproute-6.2.0-5.el8_9.x86_64.rpm 3.7 MB/s | 854 kB 00:00 2024-01-24T15:30:00.335 INFO:teuthology.orchestra.run.smithi204.stdout:(139/145): libblkid-2.32.1-43.el8.x86_64.rpm 912 kB/s | 220 kB 00:00 2024-01-24T15:30:00.341 INFO:teuthology.orchestra.run.smithi005.stdout:(119/145): openblas-threads-0.3.15-6.el8.x86_64 21 MB/s | 5.2 MB 00:00 2024-01-24T15:30:00.408 INFO:teuthology.orchestra.run.smithi005.stdout:(120/145): python3-mako-1.0.6-14.el8.noarch.rpm 576 kB/s | 157 kB 00:00 2024-01-24T15:30:00.427 INFO:teuthology.orchestra.run.smithi204.stdout:(140/145): libfdisk-2.32.1-43.el8.x86_64.rpm 1.7 MB/s | 254 kB 00:00 2024-01-24T15:30:00.517 INFO:teuthology.orchestra.run.smithi005.stdout:(121/145): openblas-0.3.15-6.el8.x86_64.rpm 14 MB/s | 5.0 MB 00:00 2024-01-24T15:30:00.550 INFO:teuthology.orchestra.run.smithi005.stdout:(122/145): libpq-13.11-1.el8.x86_64.rpm 1.4 MB/s | 198 kB 00:00 2024-01-24T15:30:00.569 INFO:teuthology.orchestra.run.smithi204.stdout:(141/145): librbd1-18.2.1-341.g4e3182a6.el8.x86 2.2 MB/s | 3.6 MB 00:01 2024-01-24T15:30:00.592 INFO:teuthology.orchestra.run.smithi005.stdout:(123/145): automake-1.16.1-8.el8.noarch.rpm 2.8 MB/s | 714 kB 00:00 2024-01-24T15:30:00.611 INFO:teuthology.orchestra.run.smithi204.stdout:(142/145): xfsprogs-5.0.0-12.el8.x86_64.rpm 3.9 MB/s | 1.1 MB 00:00 2024-01-24T15:30:00.634 INFO:teuthology.orchestra.run.smithi005.stdout:(124/145): jq-1.6-7.el8.x86_64.rpm 1.7 MB/s | 202 kB 00:00 2024-01-24T15:30:00.645 INFO:teuthology.orchestra.run.smithi204.stdout:(143/145): openssl-1.1.1k-12.el8_9.x86_64.rpm 3.2 MB/s | 711 kB 00:00 2024-01-24T15:30:00.709 INFO:teuthology.orchestra.run.smithi005.stdout:(125/145): python3-pytz-2017.2-11.el8.noarch.rp 342 kB/s | 54 kB 00:00 2024-01-24T15:30:00.720 INFO:teuthology.orchestra.run.smithi204.stdout:(144/145): openssl-libs-1.1.1k-12.el8_9.x86_64. 9.8 MB/s | 1.5 MB 00:00 2024-01-24T15:30:00.762 INFO:teuthology.orchestra.run.smithi204.stdout:(145/145): xfsdump-3.1.8-7.el8_9.x86_64.rpm 2.2 MB/s | 333 kB 00:00 2024-01-24T15:30:00.764 INFO:teuthology.orchestra.run.smithi204.stdout:-------------------------------------------------------------------------------- 2024-01-24T15:30:00.765 INFO:teuthology.orchestra.run.smithi204.stdout:Total 10 MB/s | 212 MB 00:20 2024-01-24T15:30:00.776 INFO:teuthology.orchestra.run.smithi005.stdout:(126/145): postgresql-10.23-3.module+el8.9.0+20 8.2 MB/s | 1.5 MB 00:00 2024-01-24T15:30:00.827 INFO:teuthology.orchestra.run.smithi005.stdout:(127/145): postgresql-contrib-10.23-3.module+el 4.1 MB/s | 811 kB 00:00 2024-01-24T15:30:00.969 INFO:teuthology.orchestra.run.smithi005.stdout:(128/145): postgresql-server-10.23-3.module+el8 19 MB/s | 5.1 MB 00:00 2024-01-24T15:30:01.085 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-01-24T15:30:01.303 INFO:teuthology.orchestra.run.smithi005.stdout:(129/145): python3-scipy-1.0.0-21.module+el8.9. 26 MB/s | 14 MB 00:00 2024-01-24T15:30:01.461 INFO:teuthology.orchestra.run.smithi005.stdout:(130/145): librbd1-18.2.1-341.g4e3182a6.el8.x86 7.2 MB/s | 3.6 MB 00:00 2024-01-24T15:30:01.495 INFO:teuthology.orchestra.run.smithi005.stdout:(131/145): elfutils-libelf-0.189-3.el8.x86_64.r 1.2 MB/s | 232 kB 00:00 2024-01-24T15:30:01.526 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-01-24T15:30:01.526 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-01-24T15:30:01.579 INFO:teuthology.orchestra.run.smithi005.stdout:(132/145): elfutils-libs-0.189-3.el8.x86_64.rpm 2.5 MB/s | 303 kB 00:00 2024-01-24T15:30:01.612 INFO:teuthology.orchestra.run.smithi005.stdout:(133/145): libmount-2.32.1-43.el8.x86_64.rpm 2.0 MB/s | 237 kB 00:00 2024-01-24T15:30:01.637 INFO:teuthology.orchestra.run.smithi005.stdout:(134/145): libsmartcols-2.32.1-43.el8.x86_64.rp 3.0 MB/s | 179 kB 00:00 2024-01-24T15:30:01.729 INFO:teuthology.orchestra.run.smithi005.stdout:(135/145): libuuid-2.32.1-43.el8.x86_64.rpm 846 kB/s | 99 kB 00:00 2024-01-24T15:30:01.813 INFO:teuthology.orchestra.run.smithi005.stdout:(136/145): util-linux-2.32.1-43.el8.x86_64.rpm 14 MB/s | 2.5 MB 00:00 2024-01-24T15:30:01.838 INFO:teuthology.orchestra.run.smithi005.stdout:(137/145): util-linux-user-2.32.1-43.el8.x86_64 945 kB/s | 103 kB 00:00 2024-01-24T15:30:01.905 INFO:teuthology.orchestra.run.smithi005.stdout:(138/145): librados2-18.2.1-341.g4e3182a6.el8.x 3.4 MB/s | 3.7 MB 00:01 2024-01-24T15:30:01.955 INFO:teuthology.orchestra.run.smithi005.stdout:(139/145): iproute-6.2.0-5.el8_9.x86_64.rpm 5.9 MB/s | 854 kB 00:00 2024-01-24T15:30:02.056 INFO:teuthology.orchestra.run.smithi005.stdout:(140/145): libblkid-2.32.1-43.el8.x86_64.rpm 1.0 MB/s | 220 kB 00:00 2024-01-24T15:30:02.114 INFO:teuthology.orchestra.run.smithi005.stdout:(141/145): libfdisk-2.32.1-43.el8.x86_64.rpm 1.2 MB/s | 254 kB 00:00 2024-01-24T15:30:02.157 INFO:teuthology.orchestra.run.smithi005.stdout:(142/145): xfsprogs-5.0.0-12.el8.x86_64.rpm 5.3 MB/s | 1.1 MB 00:00 2024-01-24T15:30:02.190 INFO:teuthology.orchestra.run.smithi005.stdout:(143/145): openssl-1.1.1k-12.el8_9.x86_64.rpm 5.2 MB/s | 711 kB 00:00 2024-01-24T15:30:02.283 INFO:teuthology.orchestra.run.smithi005.stdout:(144/145): openssl-libs-1.1.1k-12.el8_9.x86_64. 8.8 MB/s | 1.5 MB 00:00 2024-01-24T15:30:02.315 INFO:teuthology.orchestra.run.smithi005.stdout:(145/145): xfsdump-3.1.8-7.el8_9.x86_64.rpm 2.1 MB/s | 333 kB 00:00 2024-01-24T15:30:02.318 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-01-24T15:30:02.318 INFO:teuthology.orchestra.run.smithi005.stdout:Total 10 MB/s | 212 MB 00:20 2024-01-24T15:30:02.858 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction check 2024-01-24T15:30:03.087 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-01-24T15:30:03.099 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-01-24T15:30:03.308 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction check succeeded. 2024-01-24T15:30:03.308 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction test 2024-01-24T15:30:04.438 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-01-24T15:30:04.908 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-01-24T15:30:04.908 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-01-24T15:30:05.175 INFO:teuthology.orchestra.run.smithi204.stdout:Transaction test succeeded. 2024-01-24T15:30:05.188 INFO:teuthology.orchestra.run.smithi204.stdout:Running transaction 2024-01-24T15:30:06.536 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-01-24T15:30:06.549 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-01-24T15:30:08.975 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-01-24T15:30:09.164 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-01-24T15:30:09.378 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/161 2024-01-24T15:30:09.634 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/161 2024-01-24T15:30:09.812 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/161 2024-01-24T15:30:09.967 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/161 2024-01-24T15:30:10.063 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/161 2024-01-24T15:30:10.225 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/161 2024-01-24T15:30:10.322 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/161 2024-01-24T15:30:10.497 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/161 2024-01-24T15:30:10.702 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/161 2024-01-24T15:30:10.908 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/161 2024-01-24T15:30:11.082 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/161 2024-01-24T15:30:11.113 INFO:teuthology.orchestra.run.smithi204.stdout: Preparing : 1/1 2024-01-24T15:30:11.258 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/161 2024-01-24T15:30:11.302 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-01-24T15:30:11.555 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/161 2024-01-24T15:30:11.717 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/161 2024-01-24T15:30:11.816 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/161 2024-01-24T15:30:11.891 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librados2-2:18.2.1-341.g4e3182a6.el8.x86_64 9/161 2024-01-24T15:30:12.045 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/161 2024-01-24T15:30:12.210 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-01-24T15:30:12.276 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/161 2024-01-24T15:30:12.347 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:18.2.1-341.g4e3182a6.el8.x86_64 9/161 2024-01-24T15:30:12.376 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/161 2024-01-24T15:30:12.408 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-01-24T15:30:12.541 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librbd1-2:18.2.1-341.g4e3182a6.el8.x86_64 10/161 2024-01-24T15:30:12.584 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/161 2024-01-24T15:30:12.655 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/161 2024-01-24T15:30:12.688 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/161 2024-01-24T15:30:12.689 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:18.2.1-341.g4e3182a6.el8.x86_64 10/161 2024-01-24T15:30:12.881 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/161 2024-01-24T15:30:12.882 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs2-2:18.2.1-341.g4e3182a6.el8.x86_64 11/161 2024-01-24T15:30:12.939 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/161 2024-01-24T15:30:13.000 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephfs2-2:18.2.1-341.g4e3182a6.el8.x86_64 11/161 2024-01-24T15:30:13.128 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/161 2024-01-24T15:30:13.143 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/161 2024-01-24T15:30:13.316 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/161 2024-01-24T15:30:13.395 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rados-2:18.2.1-341.g4e3182a6.el8.x86_64 12/161 2024-01-24T15:30:13.409 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/161 2024-01-24T15:30:13.416 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/161 2024-01-24T15:30:13.555 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/161 2024-01-24T15:30:13.600 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/161 2024-01-24T15:30:13.657 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/161 2024-01-24T15:30:13.694 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/161 2024-01-24T15:30:13.770 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/161 2024-01-24T15:30:13.775 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/161 2024-01-24T15:30:13.905 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/161 2024-01-24T15:30:13.998 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libpq-13.11-1.el8.x86_64 14/161 2024-01-24T15:30:14.147 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/161 2024-01-24T15:30:14.230 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/161 2024-01-24T15:30:14.283 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/161 2024-01-24T15:30:14.341 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/161 2024-01-24T15:30:14.463 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/161 2024-01-24T15:30:14.488 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/161 2024-01-24T15:30:14.508 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : librados2-2:18.2.1-341.g4e3182a6.el8.x86_64 9/161 2024-01-24T15:30:14.683 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/161 2024-01-24T15:30:14.904 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/161 2024-01-24T15:30:14.957 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librados2-2:18.2.1-341.g4e3182a6.el8.x86_64 9/161 2024-01-24T15:30:15.129 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-10.23-3.module+el8.9.0+20831+78489779 18/161 2024-01-24T15:30:15.153 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/161 2024-01-24T15:30:15.175 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : librbd1-2:18.2.1-341.g4e3182a6.el8.x86_64 10/161 2024-01-24T15:30:15.291 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephsqlite-2:18.2.1-341.g4e3182a6.el8.x86_64 19/161 2024-01-24T15:30:15.307 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librbd1-2:18.2.1-341.g4e3182a6.el8.x86_64 10/161 2024-01-24T15:30:15.357 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librados2-2:18.2.1-341.g4e3182a6.el8.x86_64 9/161 2024-01-24T15:30:15.419 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephsqlite-2:18.2.1-341.g4e3182a6.el8.x86_64 19/161 2024-01-24T15:30:15.550 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephfs2-2:18.2.1-341.g4e3182a6.el8.x86_64 11/161 2024-01-24T15:30:15.557 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libradosstriper1-2:18.2.1-341.g4e3182a6.el8.x86_ 20/161 2024-01-24T15:30:15.650 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libradosstriper1-2:18.2.1-341.g4e3182a6.el8.x86_ 20/161 2024-01-24T15:30:15.666 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libcephfs2-2:18.2.1-341.g4e3182a6.el8.x86_64 11/161 2024-01-24T15:30:15.789 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/161 2024-01-24T15:30:15.827 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:18.2.1-341.g4e3182a6.el8.x86_64 9/161 2024-01-24T15:30:15.991 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librbd1-2:18.2.1-341.g4e3182a6.el8.x86_64 10/161 2024-01-24T15:30:16.005 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rados-2:18.2.1-341.g4e3182a6.el8.x86_64 12/161 2024-01-24T15:30:16.067 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/161 2024-01-24T15:30:16.140 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:18.2.1-341.g4e3182a6.el8.x86_64 10/161 2024-01-24T15:30:16.308 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs2-2:18.2.1-341.g4e3182a6.el8.x86_64 11/161 2024-01-24T15:30:16.354 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/161 2024-01-24T15:30:16.425 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs2-2:18.2.1-341.g4e3182a6.el8.x86_64 11/161 2024-01-24T15:30:16.480 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/161 2024-01-24T15:30:16.546 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/161 2024-01-24T15:30:16.724 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/161 2024-01-24T15:30:16.739 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libpq-13.11-1.el8.x86_64 14/161 2024-01-24T15:30:16.792 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rados-2:18.2.1-341.g4e3182a6.el8.x86_64 12/161 2024-01-24T15:30:16.892 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/161 2024-01-24T15:30:17.057 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/161 2024-01-24T15:30:17.074 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/161 2024-01-24T15:30:17.101 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/161 2024-01-24T15:30:17.176 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/161 2024-01-24T15:30:17.347 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/161 2024-01-24T15:30:17.419 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libpq-13.11-1.el8.x86_64 14/161 2024-01-24T15:30:17.712 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/161 2024-01-24T15:30:17.746 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/161 2024-01-24T15:30:17.822 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/161 2024-01-24T15:30:17.897 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/161 2024-01-24T15:30:17.907 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/161 2024-01-24T15:30:18.163 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : postgresql-10.23-3.module+el8.9.0+20831+78489779 18/161 2024-01-24T15:30:18.349 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/161 2024-01-24T15:30:18.375 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephsqlite-2:18.2.1-341.g4e3182a6.el8.x86_64 19/161 2024-01-24T15:30:18.503 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libcephsqlite-2:18.2.1-341.g4e3182a6.el8.x86_64 19/161 2024-01-24T15:30:18.588 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-10.23-3.module+el8.9.0+20831+78489779 18/161 2024-01-24T15:30:18.603 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/161 2024-01-24T15:30:18.725 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libradosstriper1-2:18.2.1-341.g4e3182a6.el8.x86_ 20/161 2024-01-24T15:30:18.741 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephsqlite-2:18.2.1-341.g4e3182a6.el8.x86_64 19/161 2024-01-24T15:30:18.799 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/161 2024-01-24T15:30:18.825 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libradosstriper1-2:18.2.1-341.g4e3182a6.el8.x86_ 20/161 2024-01-24T15:30:18.868 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephsqlite-2:18.2.1-341.g4e3182a6.el8.x86_64 19/161 2024-01-24T15:30:18.980 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/161 2024-01-24T15:30:19.016 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libradosstriper1-2:18.2.1-341.g4e3182a6.el8.x86_ 20/161 2024-01-24T15:30:19.105 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libradosstriper1-2:18.2.1-341.g4e3182a6.el8.x86_ 20/161 2024-01-24T15:30:19.273 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/161 2024-01-24T15:30:19.316 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/161 2024-01-24T15:30:19.548 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/161 2024-01-24T15:30:19.587 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/161 2024-01-24T15:30:19.630 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/161 2024-01-24T15:30:19.789 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/161 2024-01-24T15:30:19.849 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/161 2024-01-24T15:30:19.864 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/161 2024-01-24T15:30:19.965 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/161 2024-01-24T15:30:20.011 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/161 2024-01-24T15:30:20.057 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/161 2024-01-24T15:30:20.120 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/161 2024-01-24T15:30:20.242 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/161 2024-01-24T15:30:20.313 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/161 2024-01-24T15:30:20.318 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/161 2024-01-24T15:30:20.548 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-common-2:18.2.1-341.g4e3182a6.el8.x 31/161 2024-01-24T15:30:20.685 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-argparse-2:18.2.1-341.g4e3182a6.el8 32/161 2024-01-24T15:30:20.927 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/161 2024-01-24T15:30:20.984 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cephfs-2:18.2.1-341.g4e3182a6.el8.x86_64 33/161 2024-01-24T15:30:21.024 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/161 2024-01-24T15:30:21.158 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/161 2024-01-24T15:30:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/161 2024-01-24T15:30:21.207 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/161 2024-01-24T15:30:21.828 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/161 2024-01-24T15:30:21.896 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/161 2024-01-24T15:30:22.049 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/161 2024-01-24T15:30:22.065 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/161 2024-01-24T15:30:22.872 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/161 2024-01-24T15:30:22.942 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/161 2024-01-24T15:30:23.240 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/161 2024-01-24T15:30:23.248 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/161 2024-01-24T15:30:23.268 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/161 2024-01-24T15:30:23.481 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/161 2024-01-24T15:30:23.492 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/161 2024-01-24T15:30:23.630 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 35/161 2024-01-24T15:30:23.739 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/161 2024-01-24T15:30:23.777 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/161 2024-01-24T15:30:23.955 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-common-2:18.2.1-341.g4e3182a6.el8.x 31/161 2024-01-24T15:30:24.059 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ceph-common-2:18.2.1-341.g4e3182a6.el8.x 31/161 2024-01-24T15:30:24.120 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-argparse-2:18.2.1-341.g4e3182a6.el8 32/161 2024-01-24T15:30:24.211 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-ceph-argparse-2:18.2.1-341.g4e3182a6.el8 32/161 2024-01-24T15:30:24.390 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cephfs-2:18.2.1-341.g4e3182a6.el8.x86_64 33/161 2024-01-24T15:30:24.571 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cephfs-2:18.2.1-341.g4e3182a6.el8.x86_64 33/161 2024-01-24T15:30:24.607 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/161 2024-01-24T15:30:24.684 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/161 2024-01-24T15:30:24.857 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/161 2024-01-24T15:30:25.028 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/161 2024-01-24T15:30:25.256 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/161 2024-01-24T15:30:25.493 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/161 2024-01-24T15:30:25.719 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/161 2024-01-24T15:30:25.955 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rbd-2:18.2.1-341.g4e3182a6.el8.x86_64 41/161 2024-01-24T15:30:26.136 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librados-devel-2:18.2.1-341.g4e3182a6.el8.x86_64 42/161 2024-01-24T15:30:26.314 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 43/161 2024-01-24T15:30:26.420 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 43/161 2024-01-24T15:30:26.664 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/161 2024-01-24T15:30:26.749 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/161 2024-01-24T15:30:26.808 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/161 2024-01-24T15:30:26.907 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/161 2024-01-24T15:30:26.923 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 45/161 2024-01-24T15:30:27.118 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/161 2024-01-24T15:30:27.168 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 35/161 2024-01-24T15:30:27.305 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/161 2024-01-24T15:30:27.364 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 35/161 2024-01-24T15:30:27.895 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/161 2024-01-24T15:30:28.198 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/161 2024-01-24T15:30:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/161 2024-01-24T15:30:28.323 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/161 2024-01-24T15:30:28.482 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/161 2024-01-24T15:30:28.592 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : automake-1.16.1-8.el8.noarch 49/161 2024-01-24T15:30:28.711 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/161 2024-01-24T15:30:28.755 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : uuid-1.6.2-43.el8.x86_64 50/161 2024-01-24T15:30:28.857 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 50/161 2024-01-24T15:30:28.917 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/161 2024-01-24T15:30:28.941 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/161 2024-01-24T15:30:29.005 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 51/161 2024-01-24T15:30:29.098 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 51/161 2024-01-24T15:30:29.171 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/161 2024-01-24T15:30:29.213 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/161 2024-01-24T15:30:29.306 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : jq-1.6-7.el8.x86_64 52/161 2024-01-24T15:30:29.414 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/161 2024-01-24T15:30:29.471 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/161 2024-01-24T15:30:29.484 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/161 2024-01-24T15:30:29.606 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rbd-2:18.2.1-341.g4e3182a6.el8.x86_64 41/161 2024-01-24T15:30:29.647 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 54/161 2024-01-24T15:30:29.746 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/161 2024-01-24T15:30:29.797 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librados-devel-2:18.2.1-341.g4e3182a6.el8.x86_64 42/161 2024-01-24T15:30:29.829 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 55/161 2024-01-24T15:30:29.997 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 43/161 2024-01-24T15:30:30.027 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : fuse-2.9.7-17.el8.x86_64 56/161 2024-01-24T15:30:30.030 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rbd-2:18.2.1-341.g4e3182a6.el8.x86_64 41/161 2024-01-24T15:30:30.105 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 43/161 2024-01-24T15:30:30.216 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 57/161 2024-01-24T15:30:30.290 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librados-devel-2:18.2.1-341.g4e3182a6.el8.x86_64 42/161 2024-01-24T15:30:30.347 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/161 2024-01-24T15:30:30.404 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/161 2024-01-24T15:30:30.440 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/161 2024-01-24T15:30:30.556 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 43/161 2024-01-24T15:30:30.559 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/161 2024-01-24T15:30:30.644 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 45/161 2024-01-24T15:30:30.665 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 43/161 2024-01-24T15:30:30.793 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/161 2024-01-24T15:30:30.883 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/161 2024-01-24T15:30:30.948 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/161 2024-01-24T15:30:31.036 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/161 2024-01-24T15:30:31.089 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 61/161 2024-01-24T15:30:31.089 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/161 2024-01-24T15:30:31.207 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 45/161 2024-01-24T15:30:31.367 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 62/161 2024-01-24T15:30:31.473 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/161 2024-01-24T15:30:31.611 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 63/161 2024-01-24T15:30:31.684 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/161 2024-01-24T15:30:31.731 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/161 2024-01-24T15:30:31.825 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 64/161 2024-01-24T15:30:31.983 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/161 2024-01-24T15:30:32.031 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 65/161 2024-01-24T15:30:32.111 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/161 2024-01-24T15:30:32.298 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/161 2024-01-24T15:30:32.338 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : automake-1.16.1-8.el8.noarch 49/161 2024-01-24T15:30:32.486 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 66/161 2024-01-24T15:30:32.539 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : uuid-1.6.2-43.el8.x86_64 50/161 2024-01-24T15:30:32.649 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 50/161 2024-01-24T15:30:32.724 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/161 2024-01-24T15:30:32.805 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 51/161 2024-01-24T15:30:32.820 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 67/161 2024-01-24T15:30:32.847 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/161 2024-01-24T15:30:32.906 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 51/161 2024-01-24T15:30:33.030 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 68/161 2024-01-24T15:30:33.082 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : jq-1.6-7.el8.x86_64 52/161 2024-01-24T15:30:33.134 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : automake-1.16.1-8.el8.noarch 49/161 2024-01-24T15:30:33.275 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 69/161 2024-01-24T15:30:33.298 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/161 2024-01-24T15:30:33.406 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : uuid-1.6.2-43.el8.x86_64 50/161 2024-01-24T15:30:33.474 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 54/161 2024-01-24T15:30:33.496 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 50/161 2024-01-24T15:30:33.540 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 70/161 2024-01-24T15:30:33.674 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 55/161 2024-01-24T15:30:33.722 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 51/161 2024-01-24T15:30:33.819 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 51/161 2024-01-24T15:30:33.862 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : fuse-2.9.7-17.el8.x86_64 56/161 2024-01-24T15:30:33.862 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 71/161 2024-01-24T15:30:34.024 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : jq-1.6-7.el8.x86_64 52/161 2024-01-24T15:30:34.081 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 72/161 2024-01-24T15:30:34.088 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 57/161 2024-01-24T15:30:34.256 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/161 2024-01-24T15:30:34.300 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/161 2024-01-24T15:30:34.332 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 73/161 2024-01-24T15:30:34.448 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 54/161 2024-01-24T15:30:34.470 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/161 2024-01-24T15:30:34.557 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 74/161 2024-01-24T15:30:34.677 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 55/161 2024-01-24T15:30:34.746 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 75/161 2024-01-24T15:30:34.779 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/161 2024-01-24T15:30:34.920 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : fuse-2.9.7-17.el8.x86_64 56/161 2024-01-24T15:30:35.074 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 76/161 2024-01-24T15:30:35.096 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 61/161 2024-01-24T15:30:35.177 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 57/161 2024-01-24T15:30:35.248 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 77/161 2024-01-24T15:30:35.376 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 62/161 2024-01-24T15:30:35.440 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/161 2024-01-24T15:30:35.454 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 78/161 2024-01-24T15:30:35.645 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 63/161 2024-01-24T15:30:35.727 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/161 2024-01-24T15:30:35.746 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 79/161 2024-01-24T15:30:35.835 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 64/161 2024-01-24T15:30:35.954 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/161 2024-01-24T15:30:35.962 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 80/161 2024-01-24T15:30:36.062 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 65/161 2024-01-24T15:30:36.134 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 81/161 2024-01-24T15:30:36.326 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 61/161 2024-01-24T15:30:36.350 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 82/161 2024-01-24T15:30:36.560 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 83/161 2024-01-24T15:30:36.630 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 66/161 2024-01-24T15:30:36.657 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 62/161 2024-01-24T15:30:36.811 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 84/161 2024-01-24T15:30:36.886 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 63/161 2024-01-24T15:30:36.921 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 67/161 2024-01-24T15:30:36.977 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 85/161 2024-01-24T15:30:37.109 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 64/161 2024-01-24T15:30:37.166 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 86/161 2024-01-24T15:30:37.189 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 68/161 2024-01-24T15:30:37.319 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 87/161 2024-01-24T15:30:37.348 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 65/161 2024-01-24T15:30:37.424 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 69/161 2024-01-24T15:30:37.585 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 88/161 2024-01-24T15:30:37.692 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 70/161 2024-01-24T15:30:37.802 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 89/161 2024-01-24T15:30:37.880 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 66/161 2024-01-24T15:30:38.003 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 90/161 2024-01-24T15:30:38.032 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 71/161 2024-01-24T15:30:38.262 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 67/161 2024-01-24T15:30:38.277 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-portend-2.6-1.el8.noarch 91/161 2024-01-24T15:30:38.282 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 72/161 2024-01-24T15:30:38.500 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 73/161 2024-01-24T15:30:38.521 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 68/161 2024-01-24T15:30:38.547 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 92/161 2024-01-24T15:30:38.724 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 74/161 2024-01-24T15:30:38.747 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 93/161 2024-01-24T15:30:38.792 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 69/161 2024-01-24T15:30:38.946 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 75/161 2024-01-24T15:30:38.962 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 94/161 2024-01-24T15:30:39.081 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 70/161 2024-01-24T15:30:39.193 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 76/161 2024-01-24T15:30:39.367 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 77/161 2024-01-24T15:30:39.419 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 71/161 2024-01-24T15:30:39.550 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 78/161 2024-01-24T15:30:39.707 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 72/161 2024-01-24T15:30:39.817 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 79/161 2024-01-24T15:30:40.000 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 73/161 2024-01-24T15:30:40.180 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 80/161 2024-01-24T15:30:40.283 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 74/161 2024-01-24T15:30:40.336 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 81/161 2024-01-24T15:30:40.340 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 95/161 2024-01-24T15:30:40.503 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 82/161 2024-01-24T15:30:40.542 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 75/161 2024-01-24T15:30:40.698 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 83/161 2024-01-24T15:30:40.707 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 96/161 2024-01-24T15:30:40.901 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 76/161 2024-01-24T15:30:40.947 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 84/161 2024-01-24T15:30:40.967 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/161 2024-01-24T15:30:41.141 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 77/161 2024-01-24T15:30:41.156 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 85/161 2024-01-24T15:30:41.302 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 98/161 2024-01-24T15:30:41.317 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 86/161 2024-01-24T15:30:41.400 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 78/161 2024-01-24T15:30:41.470 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 87/161 2024-01-24T15:30:41.591 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 99/161 2024-01-24T15:30:41.718 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 79/161 2024-01-24T15:30:41.734 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 88/161 2024-01-24T15:30:41.799 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 100/161 2024-01-24T15:30:41.928 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 89/161 2024-01-24T15:30:42.005 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 80/161 2024-01-24T15:30:42.103 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 90/161 2024-01-24T15:30:42.211 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 81/161 2024-01-24T15:30:42.385 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-portend-2.6-1.el8.noarch 91/161 2024-01-24T15:30:42.461 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 82/161 2024-01-24T15:30:42.631 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 92/161 2024-01-24T15:30:42.695 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 83/161 2024-01-24T15:30:42.808 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 93/161 2024-01-24T15:30:42.847 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 101/161 2024-01-24T15:30:43.002 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 84/161 2024-01-24T15:30:43.011 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librgw2-2:18.2.1-341.g4e3182a6.el8.x86_64 102/161 2024-01-24T15:30:43.024 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 94/161 2024-01-24T15:30:43.111 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librgw2-2:18.2.1-341.g4e3182a6.el8.x86_64 102/161 2024-01-24T15:30:43.246 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 85/161 2024-01-24T15:30:43.303 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rgw-2:18.2.1-341.g4e3182a6.el8.x86_64 103/161 2024-01-24T15:30:43.459 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 86/161 2024-01-24T15:30:43.620 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 87/161 2024-01-24T15:30:43.928 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 88/161 2024-01-24T15:30:44.194 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 89/161 2024-01-24T15:30:44.403 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 90/161 2024-01-24T15:30:44.418 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 95/161 2024-01-24T15:30:44.726 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-portend-2.6-1.el8.noarch 91/161 2024-01-24T15:30:44.777 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 96/161 2024-01-24T15:30:45.005 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 92/161 2024-01-24T15:30:45.011 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/161 2024-01-24T15:30:45.255 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 93/161 2024-01-24T15:30:45.354 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 98/161 2024-01-24T15:30:45.627 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 99/161 2024-01-24T15:30:45.869 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 100/161 2024-01-24T15:30:46.281 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 94/161 2024-01-24T15:30:46.714 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 101/161 2024-01-24T15:30:46.870 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librgw2-2:18.2.1-341.g4e3182a6.el8.x86_64 102/161 2024-01-24T15:30:46.970 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librgw2-2:18.2.1-341.g4e3182a6.el8.x86_64 102/161 2024-01-24T15:30:47.145 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rgw-2:18.2.1-341.g4e3182a6.el8.x86_64 103/161 2024-01-24T15:30:47.626 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 95/161 2024-01-24T15:30:47.973 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 96/161 2024-01-24T15:30:48.274 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/161 2024-01-24T15:30:48.595 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:18.2.1-341.g4e3182a6.el8.x86_64 104/161 2024-01-24T15:30:48.615 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 98/161 2024-01-24T15:30:48.828 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-common-2:18.2.1-341.g4e3182a6.el8.x86_64 104/161 2024-01-24T15:30:48.930 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 99/161 2024-01-24T15:30:49.229 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 100/161 2024-01-24T15:30:49.521 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:18.2.1-341.g4e3182a6.el8.x86_64 104/161 2024-01-24T15:30:49.814 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-base-2:18.2.1-341.g4e3182a6.el8.x86_64 105/161 2024-01-24T15:30:49.974 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-base-2:18.2.1-341.g4e3182a6.el8.x86_64 105/161 2024-01-24T15:30:50.135 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-selinux-2:18.2.1-341.g4e3182a6.el8.x86_64 106/161 2024-01-24T15:30:50.167 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 101/161 2024-01-24T15:30:50.395 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : librgw2-2:18.2.1-341.g4e3182a6.el8.x86_64 102/161 2024-01-24T15:30:50.509 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librgw2-2:18.2.1-341.g4e3182a6.el8.x86_64 102/161 2024-01-24T15:30:50.745 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : python3-rgw-2:18.2.1-341.g4e3182a6.el8.x86_64 103/161 2024-01-24T15:30:52.383 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:18.2.1-341.g4e3182a6.el8.x86_64 104/161 2024-01-24T15:30:52.612 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-common-2:18.2.1-341.g4e3182a6.el8.x86_64 104/161 2024-01-24T15:30:53.323 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:18.2.1-341.g4e3182a6.el8.x86_64 104/161 2024-01-24T15:30:53.616 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-base-2:18.2.1-341.g4e3182a6.el8.x86_64 105/161 2024-01-24T15:30:54.059 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-base-2:18.2.1-341.g4e3182a6.el8.x86_64 105/161 2024-01-24T15:30:54.661 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-selinux-2:18.2.1-341.g4e3182a6.el8.x86_64 106/161 2024-01-24T15:30:55.562 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-common-2:18.2.1-341.g4e3182a6.el8.x86_64 104/161 2024-01-24T15:30:55.862 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-common-2:18.2.1-341.g4e3182a6.el8.x86_64 104/161 2024-01-24T15:30:57.095 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-common-2:18.2.1-341.g4e3182a6.el8.x86_64 104/161 2024-01-24T15:30:57.433 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-base-2:18.2.1-341.g4e3182a6.el8.x86_64 105/161 2024-01-24T15:30:57.581 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-base-2:18.2.1-341.g4e3182a6.el8.x86_64 105/161 2024-01-24T15:30:57.770 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-selinux-2:18.2.1-341.g4e3182a6.el8.x86_64 106/161 2024-01-24T15:31:11.316 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-selinux-2:18.2.1-341.g4e3182a6.el8.x86_64 106/161 2024-01-24T15:31:11.316 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /sys 2024-01-24T15:31:11.316 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /proc 2024-01-24T15:31:11.316 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /dev 2024-01-24T15:31:11.316 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /run 2024-01-24T15:31:11.316 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /mnt 2024-01-24T15:31:11.316 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /var/tmp 2024-01-24T15:31:11.316 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /home 2024-01-24T15:31:11.317 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /tmp 2024-01-24T15:31:11.317 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /dev 2024-01-24T15:31:11.317 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-01-24T15:31:11.708 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-volume-2:18.2.1-341.g4e3182a6.el8.noarch 107/161 2024-01-24T15:31:13.402 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-volume-2:18.2.1-341.g4e3182a6.el8.noarch 107/161 2024-01-24T15:31:13.552 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-osd-2:18.2.1-341.g4e3182a6.el8.x86_64 108/161 2024-01-24T15:31:13.818 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-osd-2:18.2.1-341.g4e3182a6.el8.x86_64 108/161 2024-01-24T15:31:13.990 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mds-2:18.2.1-341.g4e3182a6.el8.x86_64 109/161 2024-01-24T15:31:14.513 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mds-2:18.2.1-341.g4e3182a6.el8.x86_64 109/161 2024-01-24T15:31:14.690 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mon-2:18.2.1-341.g4e3182a6.el8.x86_64 110/161 2024-01-24T15:31:14.732 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mon-2:18.2.1-341.g4e3182a6.el8.x86_64 110/161 2024-01-24T15:31:16.265 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-selinux-2:18.2.1-341.g4e3182a6.el8.x86_64 106/161 2024-01-24T15:31:16.265 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /sys 2024-01-24T15:31:16.265 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /proc 2024-01-24T15:31:16.265 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /dev 2024-01-24T15:31:16.265 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /run 2024-01-24T15:31:16.266 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /mnt 2024-01-24T15:31:16.266 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /var/tmp 2024-01-24T15:31:16.266 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /home 2024-01-24T15:31:16.266 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /tmp 2024-01-24T15:31:16.266 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /dev 2024-01-24T15:31:16.266 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:31:16.666 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-volume-2:18.2.1-341.g4e3182a6.el8.noarch 107/161 2024-01-24T15:31:17.458 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephadm-2:18.2.1-341.g4e3182a6.el8.noarch 111/161 2024-01-24T15:31:17.605 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephadm-2:18.2.1-341.g4e3182a6.el8.noarch 111/161 2024-01-24T15:31:17.723 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-prometheus-alerts-2:18.2.1-341.g4e3182a6.el 112/161 2024-01-24T15:31:17.922 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-grafana-dashboards-2:18.2.1-341.g4e3182a6.e 113/161 2024-01-24T15:31:18.131 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-cephadm-2:18.2.1-341.g4e3182a6.el8.noar 114/161 2024-01-24T15:31:18.405 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.1-341.g4e3182a6.el8.noar 114/161 2024-01-24T15:31:18.467 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-volume-2:18.2.1-341.g4e3182a6.el8.noarch 107/161 2024-01-24T15:31:18.662 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-osd-2:18.2.1-341.g4e3182a6.el8.x86_64 108/161 2024-01-24T15:31:18.676 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-dashboard-2:18.2.1-341.g4e3182a6.el8.no 115/161 2024-01-24T15:31:18.693 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-selinux-2:18.2.1-341.g4e3182a6.el8.x86_64 106/161 2024-01-24T15:31:18.693 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /sys 2024-01-24T15:31:18.694 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /proc 2024-01-24T15:31:18.694 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /dev 2024-01-24T15:31:18.694 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /run 2024-01-24T15:31:18.694 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /mnt 2024-01-24T15:31:18.694 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /var/tmp 2024-01-24T15:31:18.694 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /home 2024-01-24T15:31:18.694 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /tmp 2024-01-24T15:31:18.694 INFO:teuthology.orchestra.run.smithi204.stdout:skipping the directory /dev 2024-01-24T15:31:18.694 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-01-24T15:31:18.942 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-osd-2:18.2.1-341.g4e3182a6.el8.x86_64 108/161 2024-01-24T15:31:19.132 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mds-2:18.2.1-341.g4e3182a6.el8.x86_64 109/161 2024-01-24T15:31:19.151 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-volume-2:18.2.1-341.g4e3182a6.el8.noarch 107/161 2024-01-24T15:31:19.681 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mds-2:18.2.1-341.g4e3182a6.el8.x86_64 109/161 2024-01-24T15:31:19.767 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.1-341.g4e3182a6.el8.no 115/161 2024-01-24T15:31:19.841 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mon-2:18.2.1-341.g4e3182a6.el8.x86_64 110/161 2024-01-24T15:31:19.883 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mon-2:18.2.1-341.g4e3182a6.el8.x86_64 110/161 2024-01-24T15:31:19.947 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.1-341.g4e31 116/161 2024-01-24T15:31:20.079 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.1-341.g4e31 116/161 2024-01-24T15:31:20.533 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-modules-core-2:18.2.1-341.g4e3182a6.el8 117/161 2024-01-24T15:31:20.693 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-2:18.2.1-341.g4e3182a6.el8.x86_64 118/161 2024-01-24T15:31:20.761 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-2:18.2.1-341.g4e3182a6.el8.x86_64 118/161 2024-01-24T15:31:20.846 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-volume-2:18.2.1-341.g4e3182a6.el8.noarch 107/161 2024-01-24T15:31:20.914 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-rook-2:18.2.1-341.g4e3182a6.el8.noarch 119/161 2024-01-24T15:31:20.943 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.1-341.g4e3182a6.el8.noarch 119/161 2024-01-24T15:31:21.088 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-osd-2:18.2.1-341.g4e3182a6.el8.x86_64 108/161 2024-01-24T15:31:21.354 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-osd-2:18.2.1-341.g4e3182a6.el8.x86_64 108/161 2024-01-24T15:31:21.542 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mds-2:18.2.1-341.g4e3182a6.el8.x86_64 109/161 2024-01-24T15:31:22.061 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mds-2:18.2.1-341.g4e3182a6.el8.x86_64 109/161 2024-01-24T15:31:22.275 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mon-2:18.2.1-341.g4e3182a6.el8.x86_64 110/161 2024-01-24T15:31:22.316 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mon-2:18.2.1-341.g4e3182a6.el8.x86_64 110/161 2024-01-24T15:31:22.332 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-2:18.2.1-341.g4e3182a6.el8.x86_64 120/161 2024-01-24T15:31:22.551 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-radosgw-2:18.2.1-341.g4e3182a6.el8.x86_64 121/161 2024-01-24T15:31:22.613 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-radosgw-2:18.2.1-341.g4e3182a6.el8.x86_64 121/161 2024-01-24T15:31:22.767 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephadm-2:18.2.1-341.g4e3182a6.el8.noarch 111/161 2024-01-24T15:31:22.781 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-immutable-object-cache-2:18.2.1-341.g4e3182 122/161 2024-01-24T15:31:22.851 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.1-341.g4e3182 122/161 2024-01-24T15:31:22.923 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephadm-2:18.2.1-341.g4e3182a6.el8.noarch 111/161 2024-01-24T15:31:23.031 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-mirror-2:18.2.1-341.g4e3182a6.el8.x86_64 123/161 2024-01-24T15:31:23.082 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-prometheus-alerts-2:18.2.1-341.g4e3182a6.el 112/161 2024-01-24T15:31:23.282 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-grafana-dashboards-2:18.2.1-341.g4e3182a6.e 113/161 2024-01-24T15:31:23.437 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephfs-mirror-2:18.2.1-341.g4e3182a6.el8.x86_64 123/161 2024-01-24T15:31:23.506 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-cephadm-2:18.2.1-341.g4e3182a6.el8.noar 114/161 2024-01-24T15:31:23.622 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-mirror-2:18.2.1-341.g4e3182a6.el8.x86_64 124/161 2024-01-24T15:31:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.1-341.g4e3182a6.el8.noar 114/161 2024-01-24T15:31:24.002 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-dashboard-2:18.2.1-341.g4e3182a6.el8.no 115/161 2024-01-24T15:31:25.033 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: cephadm-2:18.2.1-341.g4e3182a6.el8.noarch 111/161 2024-01-24T15:31:25.160 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.1-341.g4e3182a6.el8.no 115/161 2024-01-24T15:31:25.235 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephadm-2:18.2.1-341.g4e3182a6.el8.noarch 111/161 2024-01-24T15:31:25.347 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.1-341.g4e31 116/161 2024-01-24T15:31:25.396 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-prometheus-alerts-2:18.2.1-341.g4e3182a6.el 112/161 2024-01-24T15:31:25.488 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.1-341.g4e31 116/161 2024-01-24T15:31:25.682 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-grafana-dashboards-2:18.2.1-341.g4e3182a6.e 113/161 2024-01-24T15:31:25.910 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-modules-core-2:18.2.1-341.g4e3182a6.el8 117/161 2024-01-24T15:31:26.024 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-cephadm-2:18.2.1-341.g4e3182a6.el8.noar 114/161 2024-01-24T15:31:26.078 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-2:18.2.1-341.g4e3182a6.el8.x86_64 118/161 2024-01-24T15:31:26.148 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-2:18.2.1-341.g4e3182a6.el8.x86_64 118/161 2024-01-24T15:31:26.288 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.1-341.g4e3182a6.el8.noar 114/161 2024-01-24T15:31:26.297 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-rook-2:18.2.1-341.g4e3182a6.el8.noarch 119/161 2024-01-24T15:31:26.327 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.1-341.g4e3182a6.el8.noarch 119/161 2024-01-24T15:31:26.554 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-dashboard-2:18.2.1-341.g4e3182a6.el8.no 115/161 2024-01-24T15:31:27.639 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.1-341.g4e3182a6.el8.no 115/161 2024-01-24T15:31:27.766 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-2:18.2.1-341.g4e3182a6.el8.x86_64 120/161 2024-01-24T15:31:27.874 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.1-341.g4e31 116/161 2024-01-24T15:31:27.986 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-radosgw-2:18.2.1-341.g4e3182a6.el8.x86_64 121/161 2024-01-24T15:31:28.005 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.1-341.g4e31 116/161 2024-01-24T15:31:28.050 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-radosgw-2:18.2.1-341.g4e3182a6.el8.x86_64 121/161 2024-01-24T15:31:28.264 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-immutable-object-cache-2:18.2.1-341.g4e3182 122/161 2024-01-24T15:31:28.337 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.1-341.g4e3182 122/161 2024-01-24T15:31:28.436 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: rbd-mirror-2:18.2.1-341.g4e3182a6.el8.x86_64 124/161 2024-01-24T15:31:28.452 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-modules-core-2:18.2.1-341.g4e3182a6.el8 117/161 2024-01-24T15:31:28.507 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-mirror-2:18.2.1-341.g4e3182a6.el8.x86_64 123/161 2024-01-24T15:31:28.679 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-2:18.2.1-341.g4e3182a6.el8.x86_64 118/161 2024-01-24T15:31:28.749 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-2:18.2.1-341.g4e3182a6.el8.x86_64 118/161 2024-01-24T15:31:28.937 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephfs-mirror-2:18.2.1-341.g4e3182a6.el8.x86_64 123/161 2024-01-24T15:31:28.957 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-mgr-rook-2:18.2.1-341.g4e3182a6.el8.noarch 119/161 2024-01-24T15:31:28.986 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.1-341.g4e3182a6.el8.noarch 119/161 2024-01-24T15:31:29.131 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-mirror-2:18.2.1-341.g4e3182a6.el8.x86_64 124/161 2024-01-24T15:31:29.759 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-test-2:18.2.1-341.g4e3182a6.el8.x86_64 125/161 2024-01-24T15:31:30.043 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 126/161 2024-01-24T15:31:30.307 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 127/161 2024-01-24T15:31:30.361 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-2:18.2.1-341.g4e3182a6.el8.x86_64 120/161 2024-01-24T15:31:30.612 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-radosgw-2:18.2.1-341.g4e3182a6.el8.x86_64 121/161 2024-01-24T15:31:30.674 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-radosgw-2:18.2.1-341.g4e3182a6.el8.x86_64 121/161 2024-01-24T15:31:30.737 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-fuse-2:18.2.1-341.g4e3182a6.el8.x86_64 128/161 2024-01-24T15:31:30.916 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-immutable-object-cache-2:18.2.1-341.g4e3182 122/161 2024-01-24T15:31:30.987 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.1-341.g4e3182 122/161 2024-01-24T15:31:31.113 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-contrib-10.23-3.module+el8.9.0+20831+ 129/161 2024-01-24T15:31:31.265 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephfs-mirror-2:18.2.1-341.g4e3182a6.el8.x86_64 123/161 2024-01-24T15:31:31.329 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libtool-2.4.6-25.el8.x86_64 130/161 2024-01-24T15:31:31.358 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 130/161 2024-01-24T15:31:31.601 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 131/161 2024-01-24T15:31:31.677 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: cephfs-mirror-2:18.2.1-341.g4e3182a6.el8.x86_64 123/161 2024-01-24T15:31:31.792 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 132/161 2024-01-24T15:31:31.898 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-mirror-2:18.2.1-341.g4e3182a6.el8.x86_64 124/161 2024-01-24T15:31:31.988 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs-devel-2:18.2.1-341.g4e3182a6.el8.x86_6 133/161 2024-01-24T15:31:34.227 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-mirror-2:18.2.1-341.g4e3182a6.el8.x86_64 124/161 2024-01-24T15:31:35.292 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: postgresql-server-10.23-3.module+el8.9.0+20831+7 134/161 2024-01-24T15:31:35.554 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-server-10.23-3.module+el8.9.0+20831+7 134/161 2024-01-24T15:31:35.622 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-test-2:18.2.1-341.g4e3182a6.el8.x86_64 125/161 2024-01-24T15:31:35.625 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: postgresql-server-10.23-3.module+el8.9.0+20831+7 134/161 2024-01-24T15:31:35.927 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 126/161 2024-01-24T15:31:36.125 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 135/161 2024-01-24T15:31:36.171 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 127/161 2024-01-24T15:31:36.503 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 136/161 2024-01-24T15:31:36.630 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-fuse-2:18.2.1-341.g4e3182a6.el8.x86_64 128/161 2024-01-24T15:31:36.697 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: rbd-mirror-2:18.2.1-341.g4e3182a6.el8.x86_64 124/161 2024-01-24T15:31:36.758 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 137/161 2024-01-24T15:31:36.969 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-contrib-10.23-3.module+el8.9.0+20831+ 129/161 2024-01-24T15:31:36.970 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-top-2:18.2.1-341.g4e3182a6.el8.noarch 138/161 2024-01-24T15:31:37.229 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-fuse-2:18.2.1-341.g4e3182a6.el8.x86_64 139/161 2024-01-24T15:31:37.237 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libtool-2.4.6-25.el8.x86_64 130/161 2024-01-24T15:31:37.268 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 130/161 2024-01-24T15:31:37.511 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 131/161 2024-01-24T15:31:37.545 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-nbd-2:18.2.1-341.g4e3182a6.el8.x86_64 140/161 2024-01-24T15:31:37.693 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 132/161 2024-01-24T15:31:37.880 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 141/161 2024-01-24T15:31:37.897 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs-devel-2:18.2.1-341.g4e3182a6.el8.x86_6 133/161 2024-01-24T15:31:38.093 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-test-2:18.2.1-341.g4e3182a6.el8.x86_64 125/161 2024-01-24T15:31:38.136 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flex-2.6.1-9.el8.x86_64 142/161 2024-01-24T15:31:38.249 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 142/161 2024-01-24T15:31:38.436 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 126/161 2024-01-24T15:31:38.453 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : bison-3.0.4-10.el8.x86_64 143/161 2024-01-24T15:31:38.482 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 143/161 2024-01-24T15:31:38.669 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-13.e 144/161 2024-01-24T15:31:38.693 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-13.e 144/161 2024-01-24T15:31:38.759 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 127/161 2024-01-24T15:31:38.814 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 145/161 2024-01-24T15:31:38.978 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 146/161 2024-01-24T15:31:39.155 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 147/161 2024-01-24T15:31:39.272 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : ceph-fuse-2:18.2.1-341.g4e3182a6.el8.x86_64 128/161 2024-01-24T15:31:39.355 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 148/161 2024-01-24T15:31:39.355 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 149/161 2024-01-24T15:31:39.615 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 149/161 2024-01-24T15:31:39.616 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 150/161 2024-01-24T15:31:39.705 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : postgresql-contrib-10.23-3.module+el8.9.0+20831+ 129/161 2024-01-24T15:31:39.842 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 150/161 2024-01-24T15:31:39.842 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/161 2024-01-24T15:31:39.930 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libtool-2.4.6-25.el8.x86_64 130/161 2024-01-24T15:31:39.960 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 130/161 2024-01-24T15:31:40.126 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/161 2024-01-24T15:31:40.269 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 131/161 2024-01-24T15:31:40.338 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 152/161 2024-01-24T15:31:40.527 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 132/161 2024-01-24T15:31:40.535 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 153/161 2024-01-24T15:31:40.740 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libcephfs-devel-2:18.2.1-341.g4e3182a6.el8.x86_6 133/161 2024-01-24T15:31:40.779 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 154/161 2024-01-24T15:31:40.779 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 155/161 2024-01-24T15:31:41.039 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 155/161 2024-01-24T15:31:41.039 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 156/161 2024-01-24T15:31:41.289 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 156/161 2024-01-24T15:31:41.322 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 157/161 2024-01-24T15:31:41.457 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-10.23-3.module+el8.9.0+20831+7 134/161 2024-01-24T15:31:41.530 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 157/161 2024-01-24T15:31:41.531 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 158/161 2024-01-24T15:31:41.704 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-server-10.23-3.module+el8.9.0+20831+7 134/161 2024-01-24T15:31:41.747 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 158/161 2024-01-24T15:31:41.747 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 159/161 2024-01-24T15:31:41.778 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-10.23-3.module+el8.9.0+20831+7 134/161 2024-01-24T15:31:41.972 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 159/161 2024-01-24T15:31:42.172 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 160/161 2024-01-24T15:31:42.172 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 161/161 2024-01-24T15:31:42.271 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 135/161 2024-01-24T15:31:42.626 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 136/161 2024-01-24T15:31:42.746 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 161/161 2024-01-24T15:31:42.747 INFO:teuthology.orchestra.run.smithi160.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-01-24T15:31:42.747 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-01-24T15:31:42.868 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 137/161 2024-01-24T15:31:43.055 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-top-2:18.2.1-341.g4e3182a6.el8.noarch 138/161 2024-01-24T15:31:43.273 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-fuse-2:18.2.1-341.g4e3182a6.el8.x86_64 139/161 2024-01-24T15:31:43.455 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-2:18.2.1-341.g4e3182a6.el8.x86_64 1/161 2024-01-24T15:31:43.455 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-base-2:18.2.1-341.g4e3182a6.el8.x86_64 2/161 2024-01-24T15:31:43.455 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-common-2:18.2.1-341.g4e3182a6.el8.x86_64 3/161 2024-01-24T15:31:43.455 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-fuse-2:18.2.1-341.g4e3182a6.el8.x86_64 4/161 2024-01-24T15:31:43.455 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-immutable-object-cache-2:18.2.1-341.g4e3182 5/161 2024-01-24T15:31:43.455 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mds-2:18.2.1-341.g4e3182a6.el8.x86_64 6/161 2024-01-24T15:31:43.455 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-2:18.2.1-341.g4e3182a6.el8.x86_64 7/161 2024-01-24T15:31:43.455 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mon-2:18.2.1-341.g4e3182a6.el8.x86_64 8/161 2024-01-24T15:31:43.455 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-osd-2:18.2.1-341.g4e3182a6.el8.x86_64 9/161 2024-01-24T15:31:43.455 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-radosgw-2:18.2.1-341.g4e3182a6.el8.x86_64 10/161 2024-01-24T15:31:43.455 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-selinux-2:18.2.1-341.g4e3182a6.el8.x86_64 11/161 2024-01-24T15:31:43.456 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-test-2:18.2.1-341.g4e3182a6.el8.x86_64 12/161 2024-01-24T15:31:43.456 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-mirror-2:18.2.1-341.g4e3182a6.el8.x86_64 13/161 2024-01-24T15:31:43.456 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs-devel-2:18.2.1-341.g4e3182a6.el8.x86_6 14/161 2024-01-24T15:31:43.456 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs2-2:18.2.1-341.g4e3182a6.el8.x86_64 15/161 2024-01-24T15:31:43.456 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephsqlite-2:18.2.1-341.g4e3182a6.el8.x86_64 16/161 2024-01-24T15:31:43.456 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados-devel-2:18.2.1-341.g4e3182a6.el8.x86_64 17/161 2024-01-24T15:31:43.456 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libradosstriper1-2:18.2.1-341.g4e3182a6.el8.x86_ 18/161 2024-01-24T15:31:43.456 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librgw2-2:18.2.1-341.g4e3182a6.el8.x86_64 19/161 2024-01-24T15:31:43.456 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-argparse-2:18.2.1-341.g4e3182a6.el8 20/161 2024-01-24T15:31:43.456 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-common-2:18.2.1-341.g4e3182a6.el8.x 21/161 2024-01-24T15:31:43.459 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cephfs-2:18.2.1-341.g4e3182a6.el8.x86_64 22/161 2024-01-24T15:31:43.459 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rados-2:18.2.1-341.g4e3182a6.el8.x86_64 23/161 2024-01-24T15:31:43.459 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rbd-2:18.2.1-341.g4e3182a6.el8.x86_64 24/161 2024-01-24T15:31:43.459 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rgw-2:18.2.1-341.g4e3182a6.el8.x86_64 25/161 2024-01-24T15:31:43.459 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-fuse-2:18.2.1-341.g4e3182a6.el8.x86_64 26/161 2024-01-24T15:31:43.459 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-mirror-2:18.2.1-341.g4e3182a6.el8.x86_64 27/161 2024-01-24T15:31:43.475 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-nbd-2:18.2.1-341.g4e3182a6.el8.x86_64 28/161 2024-01-24T15:31:43.475 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-grafana-dashboards-2:18.2.1-341.g4e3182a6.e 29/161 2024-01-24T15:31:43.475 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-cephadm-2:18.2.1-341.g4e3182a6.el8.noar 30/161 2024-01-24T15:31:43.475 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-dashboard-2:18.2.1-341.g4e3182a6.el8.no 31/161 2024-01-24T15:31:43.475 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.1-341.g4e31 32/161 2024-01-24T15:31:43.475 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-modules-core-2:18.2.1-341.g4e3182a6.el8 33/161 2024-01-24T15:31:43.475 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-rook-2:18.2.1-341.g4e3182a6.el8.noarch 34/161 2024-01-24T15:31:43.475 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-prometheus-alerts-2:18.2.1-341.g4e3182a6.el 35/161 2024-01-24T15:31:43.476 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-volume-2:18.2.1-341.g4e3182a6.el8.noarch 36/161 2024-01-24T15:31:43.476 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephadm-2:18.2.1-341.g4e3182a6.el8.noarch 37/161 2024-01-24T15:31:43.476 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-top-2:18.2.1-341.g4e3182a6.el8.noarch 38/161 2024-01-24T15:31:43.476 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/161 2024-01-24T15:31:43.476 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/161 2024-01-24T15:31:43.476 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/161 2024-01-24T15:31:43.476 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/161 2024-01-24T15:31:43.477 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/161 2024-01-24T15:31:43.477 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/161 2024-01-24T15:31:43.477 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/161 2024-01-24T15:31:43.477 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/161 2024-01-24T15:31:43.477 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/161 2024-01-24T15:31:43.477 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/161 2024-01-24T15:31:43.477 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/161 2024-01-24T15:31:43.477 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/161 2024-01-24T15:31:43.477 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/161 2024-01-24T15:31:43.477 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/161 2024-01-24T15:31:43.477 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/161 2024-01-24T15:31:43.477 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/161 2024-01-24T15:31:43.477 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/161 2024-01-24T15:31:43.477 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/161 2024-01-24T15:31:43.478 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/161 2024-01-24T15:31:43.478 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/161 2024-01-24T15:31:43.478 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/161 2024-01-24T15:31:43.478 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/161 2024-01-24T15:31:43.478 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/161 2024-01-24T15:31:43.478 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/161 2024-01-24T15:31:43.478 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/161 2024-01-24T15:31:43.478 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/161 2024-01-24T15:31:43.478 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/161 2024-01-24T15:31:43.478 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/161 2024-01-24T15:31:43.478 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/161 2024-01-24T15:31:43.478 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/161 2024-01-24T15:31:43.479 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/161 2024-01-24T15:31:43.479 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/161 2024-01-24T15:31:43.479 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/161 2024-01-24T15:31:43.479 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 72/161 2024-01-24T15:31:43.479 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/161 2024-01-24T15:31:43.479 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/161 2024-01-24T15:31:43.479 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 75/161 2024-01-24T15:31:43.479 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/161 2024-01-24T15:31:43.479 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 77/161 2024-01-24T15:31:43.479 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 78/161 2024-01-24T15:31:43.479 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 79/161 2024-01-24T15:31:43.479 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/161 2024-01-24T15:31:43.479 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 81/161 2024-01-24T15:31:43.479 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 82/161 2024-01-24T15:31:43.480 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 83/161 2024-01-24T15:31:43.480 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 84/161 2024-01-24T15:31:43.480 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 85/161 2024-01-24T15:31:43.480 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 86/161 2024-01-24T15:31:43.480 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 87/161 2024-01-24T15:31:43.480 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 88/161 2024-01-24T15:31:43.480 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 89/161 2024-01-24T15:31:43.480 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 90/161 2024-01-24T15:31:43.480 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 91/161 2024-01-24T15:31:43.480 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 92/161 2024-01-24T15:31:43.481 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 93/161 2024-01-24T15:31:43.481 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 94/161 2024-01-24T15:31:43.481 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 95/161 2024-01-24T15:31:43.481 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 96/161 2024-01-24T15:31:43.481 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 97/161 2024-01-24T15:31:43.481 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-13.e 98/161 2024-01-24T15:31:43.481 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 99/161 2024-01-24T15:31:43.481 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 100/161 2024-01-24T15:31:43.481 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 101/161 2024-01-24T15:31:43.481 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 102/161 2024-01-24T15:31:43.481 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 103/161 2024-01-24T15:31:43.482 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 104/161 2024-01-24T15:31:43.482 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : bison-3.0.4-10.el8.x86_64 105/161 2024-01-24T15:31:43.482 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flex-2.6.1-9.el8.x86_64 106/161 2024-01-24T15:31:43.482 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 107/161 2024-01-24T15:31:43.482 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 108/161 2024-01-24T15:31:43.482 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 109/161 2024-01-24T15:31:43.482 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 110/161 2024-01-24T15:31:43.482 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 111/161 2024-01-24T15:31:43.482 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 112/161 2024-01-24T15:31:43.482 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 113/161 2024-01-24T15:31:43.482 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 114/161 2024-01-24T15:31:43.482 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 115/161 2024-01-24T15:31:43.482 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 116/161 2024-01-24T15:31:43.482 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 117/161 2024-01-24T15:31:43.483 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 118/161 2024-01-24T15:31:43.483 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 119/161 2024-01-24T15:31:43.483 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 120/161 2024-01-24T15:31:43.483 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 121/161 2024-01-24T15:31:43.483 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : automake-1.16.1-8.el8.noarch 122/161 2024-01-24T15:31:43.483 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libpq-13.11-1.el8.x86_64 123/161 2024-01-24T15:31:43.483 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : jq-1.6-7.el8.x86_64 124/161 2024-01-24T15:31:43.483 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 125/161 2024-01-24T15:31:43.483 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-10.23-3.module+el8.9.0+20831+78489779 126/161 2024-01-24T15:31:43.483 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-contrib-10.23-3.module+el8.9.0+20831+ 127/161 2024-01-24T15:31:43.483 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-server-10.23-3.module+el8.9.0+20831+7 128/161 2024-01-24T15:31:43.483 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 129/161 2024-01-24T15:31:43.484 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:18.2.1-341.g4e3182a6.el8.x86_64 130/161 2024-01-24T15:31:43.484 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 131/161 2024-01-24T15:31:43.484 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:18.2.1-341.g4e3182a6.el8.x86_64 132/161 2024-01-24T15:31:43.484 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 133/161 2024-01-24T15:31:43.484 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 134/161 2024-01-24T15:31:43.484 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 135/161 2024-01-24T15:31:43.484 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 136/161 2024-01-24T15:31:43.484 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 137/161 2024-01-24T15:31:43.484 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 138/161 2024-01-24T15:31:43.484 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 139/161 2024-01-24T15:31:43.484 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 140/161 2024-01-24T15:31:43.484 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 141/161 2024-01-24T15:31:43.484 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 142/161 2024-01-24T15:31:43.484 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 143/161 2024-01-24T15:31:43.485 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 144/161 2024-01-24T15:31:43.485 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 145/161 2024-01-24T15:31:43.485 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 146/161 2024-01-24T15:31:43.485 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 147/161 2024-01-24T15:31:43.485 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 148/161 2024-01-24T15:31:43.485 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 149/161 2024-01-24T15:31:43.485 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 150/161 2024-01-24T15:31:43.485 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 151/161 2024-01-24T15:31:43.485 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 152/161 2024-01-24T15:31:43.485 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 153/161 2024-01-24T15:31:43.485 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 154/161 2024-01-24T15:31:43.485 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 155/161 2024-01-24T15:31:43.485 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 156/161 2024-01-24T15:31:43.485 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 157/161 2024-01-24T15:31:43.485 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 158/161 2024-01-24T15:31:43.486 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 159/161 2024-01-24T15:31:43.486 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 160/161 2024-01-24T15:31:43.601 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-nbd-2:18.2.1-341.g4e3182a6.el8.x86_64 140/161 2024-01-24T15:31:43.968 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 141/161 2024-01-24T15:31:44.100 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: postgresql-server-10.23-3.module+el8.9.0+20831+7 134/161 2024-01-24T15:31:44.178 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flex-2.6.1-9.el8.x86_64 142/161 2024-01-24T15:31:44.304 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 142/161 2024-01-24T15:31:44.503 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : bison-3.0.4-10.el8.x86_64 143/161 2024-01-24T15:31:44.534 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 143/161 2024-01-24T15:31:44.564 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : postgresql-server-10.23-3.module+el8.9.0+20831+7 134/161 2024-01-24T15:31:44.628 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: postgresql-server-10.23-3.module+el8.9.0+20831+7 134/161 2024-01-24T15:31:44.720 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-13.e 144/161 2024-01-24T15:31:44.745 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-13.e 144/161 2024-01-24T15:31:44.898 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 145/161 2024-01-24T15:31:45.042 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 135/161 2024-01-24T15:31:45.110 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 146/161 2024-01-24T15:31:45.289 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 147/161 2024-01-24T15:31:45.468 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 148/161 2024-01-24T15:31:45.468 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 149/161 2024-01-24T15:31:45.517 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 136/161 2024-01-24T15:31:45.717 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 149/161 2024-01-24T15:31:45.717 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 150/161 2024-01-24T15:31:45.852 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 137/161 2024-01-24T15:31:45.978 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 150/161 2024-01-24T15:31:45.978 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/161 2024-01-24T15:31:46.064 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : cephfs-top-2:18.2.1-341.g4e3182a6.el8.noarch 138/161 2024-01-24T15:31:46.271 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/161 2024-01-24T15:31:46.356 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-fuse-2:18.2.1-341.g4e3182a6.el8.x86_64 139/161 2024-01-24T15:31:46.472 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 152/161 2024-01-24T15:31:46.663 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 153/161 2024-01-24T15:31:46.729 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : rbd-nbd-2:18.2.1-341.g4e3182a6.el8.x86_64 140/161 2024-01-24T15:31:46.889 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 154/161 2024-01-24T15:31:46.889 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 155/161 2024-01-24T15:31:47.123 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 155/161 2024-01-24T15:31:47.124 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 156/161 2024-01-24T15:31:47.164 INFO:teuthology.orchestra.run.smithi204.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 141/161 2024-01-24T15:31:47.365 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 156/161 2024-01-24T15:31:47.365 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 157/161 2024-01-24T15:31:47.420 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : flex-2.6.1-9.el8.x86_64 142/161 2024-01-24T15:31:47.548 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 142/161 2024-01-24T15:31:47.615 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 157/161 2024-01-24T15:31:47.615 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 158/161 2024-01-24T15:31:47.829 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : bison-3.0.4-10.el8.x86_64 143/161 2024-01-24T15:31:47.856 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 158/161 2024-01-24T15:31:47.856 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 159/161 2024-01-24T15:31:47.860 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 143/161 2024-01-24T15:31:48.063 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-13.e 144/161 2024-01-24T15:31:48.087 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-13.e 144/161 2024-01-24T15:31:48.106 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 159/161 2024-01-24T15:31:48.216 INFO:teuthology.orchestra.run.smithi204.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 145/161 2024-01-24T15:31:48.281 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 160/161 2024-01-24T15:31:48.281 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 161/161 2024-01-24T15:31:48.423 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 146/161 2024-01-24T15:31:48.682 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 147/161 2024-01-24T15:31:48.863 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 161/161 2024-01-24T15:31:48.863 INFO:teuthology.orchestra.run.smithi005.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-01-24T15:31:48.863 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:31:48.900 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 148/161 2024-01-24T15:31:48.900 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 149/161 2024-01-24T15:31:49.243 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 149/161 2024-01-24T15:31:49.243 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 150/161 2024-01-24T15:31:49.576 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-2:18.2.1-341.g4e3182a6.el8.x86_64 1/161 2024-01-24T15:31:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-base-2:18.2.1-341.g4e3182a6.el8.x86_64 2/161 2024-01-24T15:31:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-common-2:18.2.1-341.g4e3182a6.el8.x86_64 3/161 2024-01-24T15:31:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-fuse-2:18.2.1-341.g4e3182a6.el8.x86_64 4/161 2024-01-24T15:31:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-immutable-object-cache-2:18.2.1-341.g4e3182 5/161 2024-01-24T15:31:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mds-2:18.2.1-341.g4e3182a6.el8.x86_64 6/161 2024-01-24T15:31:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-2:18.2.1-341.g4e3182a6.el8.x86_64 7/161 2024-01-24T15:31:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mon-2:18.2.1-341.g4e3182a6.el8.x86_64 8/161 2024-01-24T15:31:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-osd-2:18.2.1-341.g4e3182a6.el8.x86_64 9/161 2024-01-24T15:31:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-radosgw-2:18.2.1-341.g4e3182a6.el8.x86_64 10/161 2024-01-24T15:31:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-selinux-2:18.2.1-341.g4e3182a6.el8.x86_64 11/161 2024-01-24T15:31:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-test-2:18.2.1-341.g4e3182a6.el8.x86_64 12/161 2024-01-24T15:31:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-mirror-2:18.2.1-341.g4e3182a6.el8.x86_64 13/161 2024-01-24T15:31:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs-devel-2:18.2.1-341.g4e3182a6.el8.x86_6 14/161 2024-01-24T15:31:49.577 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs2-2:18.2.1-341.g4e3182a6.el8.x86_64 15/161 2024-01-24T15:31:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephsqlite-2:18.2.1-341.g4e3182a6.el8.x86_64 16/161 2024-01-24T15:31:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados-devel-2:18.2.1-341.g4e3182a6.el8.x86_64 17/161 2024-01-24T15:31:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libradosstriper1-2:18.2.1-341.g4e3182a6.el8.x86_ 18/161 2024-01-24T15:31:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librgw2-2:18.2.1-341.g4e3182a6.el8.x86_64 19/161 2024-01-24T15:31:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-argparse-2:18.2.1-341.g4e3182a6.el8 20/161 2024-01-24T15:31:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-common-2:18.2.1-341.g4e3182a6.el8.x 21/161 2024-01-24T15:31:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cephfs-2:18.2.1-341.g4e3182a6.el8.x86_64 22/161 2024-01-24T15:31:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rados-2:18.2.1-341.g4e3182a6.el8.x86_64 23/161 2024-01-24T15:31:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rbd-2:18.2.1-341.g4e3182a6.el8.x86_64 24/161 2024-01-24T15:31:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rgw-2:18.2.1-341.g4e3182a6.el8.x86_64 25/161 2024-01-24T15:31:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-fuse-2:18.2.1-341.g4e3182a6.el8.x86_64 26/161 2024-01-24T15:31:49.578 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-mirror-2:18.2.1-341.g4e3182a6.el8.x86_64 27/161 2024-01-24T15:31:49.590 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-nbd-2:18.2.1-341.g4e3182a6.el8.x86_64 28/161 2024-01-24T15:31:49.590 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-grafana-dashboards-2:18.2.1-341.g4e3182a6.e 29/161 2024-01-24T15:31:49.590 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-cephadm-2:18.2.1-341.g4e3182a6.el8.noar 30/161 2024-01-24T15:31:49.591 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-dashboard-2:18.2.1-341.g4e3182a6.el8.no 31/161 2024-01-24T15:31:49.591 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.1-341.g4e31 32/161 2024-01-24T15:31:49.591 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-modules-core-2:18.2.1-341.g4e3182a6.el8 33/161 2024-01-24T15:31:49.591 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-rook-2:18.2.1-341.g4e3182a6.el8.noarch 34/161 2024-01-24T15:31:49.591 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-prometheus-alerts-2:18.2.1-341.g4e3182a6.el 35/161 2024-01-24T15:31:49.591 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-volume-2:18.2.1-341.g4e3182a6.el8.noarch 36/161 2024-01-24T15:31:49.591 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephadm-2:18.2.1-341.g4e3182a6.el8.noarch 37/161 2024-01-24T15:31:49.591 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-top-2:18.2.1-341.g4e3182a6.el8.noarch 38/161 2024-01-24T15:31:49.591 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/161 2024-01-24T15:31:49.591 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/161 2024-01-24T15:31:49.591 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/161 2024-01-24T15:31:49.591 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/161 2024-01-24T15:31:49.591 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/161 2024-01-24T15:31:49.591 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/161 2024-01-24T15:31:49.592 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/161 2024-01-24T15:31:49.592 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/161 2024-01-24T15:31:49.592 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/161 2024-01-24T15:31:49.592 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/161 2024-01-24T15:31:49.592 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/161 2024-01-24T15:31:49.592 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/161 2024-01-24T15:31:49.592 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/161 2024-01-24T15:31:49.592 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/161 2024-01-24T15:31:49.592 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/161 2024-01-24T15:31:49.592 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/161 2024-01-24T15:31:49.592 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/161 2024-01-24T15:31:49.592 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/161 2024-01-24T15:31:49.592 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/161 2024-01-24T15:31:49.592 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/161 2024-01-24T15:31:49.593 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/161 2024-01-24T15:31:49.593 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/161 2024-01-24T15:31:49.593 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/161 2024-01-24T15:31:49.593 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/161 2024-01-24T15:31:49.593 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/161 2024-01-24T15:31:49.593 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/161 2024-01-24T15:31:49.593 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/161 2024-01-24T15:31:49.593 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/161 2024-01-24T15:31:49.593 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/161 2024-01-24T15:31:49.593 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/161 2024-01-24T15:31:49.593 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/161 2024-01-24T15:31:49.593 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/161 2024-01-24T15:31:49.593 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/161 2024-01-24T15:31:49.593 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 72/161 2024-01-24T15:31:49.594 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/161 2024-01-24T15:31:49.594 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/161 2024-01-24T15:31:49.594 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 75/161 2024-01-24T15:31:49.594 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/161 2024-01-24T15:31:49.594 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 77/161 2024-01-24T15:31:49.594 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 78/161 2024-01-24T15:31:49.594 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 79/161 2024-01-24T15:31:49.594 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/161 2024-01-24T15:31:49.594 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 81/161 2024-01-24T15:31:49.594 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 82/161 2024-01-24T15:31:49.594 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 83/161 2024-01-24T15:31:49.594 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 84/161 2024-01-24T15:31:49.594 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 85/161 2024-01-24T15:31:49.594 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 86/161 2024-01-24T15:31:49.594 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 87/161 2024-01-24T15:31:49.595 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 88/161 2024-01-24T15:31:49.595 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 89/161 2024-01-24T15:31:49.595 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 90/161 2024-01-24T15:31:49.595 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 91/161 2024-01-24T15:31:49.595 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 92/161 2024-01-24T15:31:49.595 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 93/161 2024-01-24T15:31:49.595 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 94/161 2024-01-24T15:31:49.595 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 95/161 2024-01-24T15:31:49.595 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 96/161 2024-01-24T15:31:49.595 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 97/161 2024-01-24T15:31:49.595 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-13.e 98/161 2024-01-24T15:31:49.595 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 99/161 2024-01-24T15:31:49.595 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 100/161 2024-01-24T15:31:49.595 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 101/161 2024-01-24T15:31:49.596 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 102/161 2024-01-24T15:31:49.596 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 103/161 2024-01-24T15:31:49.596 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 104/161 2024-01-24T15:31:49.596 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : bison-3.0.4-10.el8.x86_64 105/161 2024-01-24T15:31:49.596 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flex-2.6.1-9.el8.x86_64 106/161 2024-01-24T15:31:49.596 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 107/161 2024-01-24T15:31:49.596 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 108/161 2024-01-24T15:31:49.596 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 109/161 2024-01-24T15:31:49.596 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 110/161 2024-01-24T15:31:49.596 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 111/161 2024-01-24T15:31:49.596 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 112/161 2024-01-24T15:31:49.596 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 113/161 2024-01-24T15:31:49.596 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 114/161 2024-01-24T15:31:49.596 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 115/161 2024-01-24T15:31:49.597 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 116/161 2024-01-24T15:31:49.597 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 117/161 2024-01-24T15:31:49.597 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 118/161 2024-01-24T15:31:49.597 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 119/161 2024-01-24T15:31:49.597 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 120/161 2024-01-24T15:31:49.597 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 121/161 2024-01-24T15:31:49.597 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : automake-1.16.1-8.el8.noarch 122/161 2024-01-24T15:31:49.597 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libpq-13.11-1.el8.x86_64 123/161 2024-01-24T15:31:49.597 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : jq-1.6-7.el8.x86_64 124/161 2024-01-24T15:31:49.597 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 125/161 2024-01-24T15:31:49.597 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-10.23-3.module+el8.9.0+20831+78489779 126/161 2024-01-24T15:31:49.597 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-contrib-10.23-3.module+el8.9.0+20831+ 127/161 2024-01-24T15:31:49.597 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-server-10.23-3.module+el8.9.0+20831+7 128/161 2024-01-24T15:31:49.597 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 129/161 2024-01-24T15:31:49.597 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:18.2.1-341.g4e3182a6.el8.x86_64 130/161 2024-01-24T15:31:49.598 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 131/161 2024-01-24T15:31:49.598 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:18.2.1-341.g4e3182a6.el8.x86_64 132/161 2024-01-24T15:31:49.598 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 133/161 2024-01-24T15:31:49.598 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 134/161 2024-01-24T15:31:49.598 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 135/161 2024-01-24T15:31:49.598 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 136/161 2024-01-24T15:31:49.598 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 137/161 2024-01-24T15:31:49.598 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 138/161 2024-01-24T15:31:49.598 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 139/161 2024-01-24T15:31:49.598 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 140/161 2024-01-24T15:31:49.598 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 141/161 2024-01-24T15:31:49.598 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 142/161 2024-01-24T15:31:49.598 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 143/161 2024-01-24T15:31:49.598 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 144/161 2024-01-24T15:31:49.599 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 145/161 2024-01-24T15:31:49.599 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 146/161 2024-01-24T15:31:49.599 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 147/161 2024-01-24T15:31:49.599 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 148/161 2024-01-24T15:31:49.599 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 149/161 2024-01-24T15:31:49.599 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 150/161 2024-01-24T15:31:49.599 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 151/161 2024-01-24T15:31:49.599 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 152/161 2024-01-24T15:31:49.599 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 153/161 2024-01-24T15:31:49.599 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 154/161 2024-01-24T15:31:49.599 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 155/161 2024-01-24T15:31:49.599 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 156/161 2024-01-24T15:31:49.599 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 157/161 2024-01-24T15:31:49.599 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 158/161 2024-01-24T15:31:49.599 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 159/161 2024-01-24T15:31:49.599 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 160/161 2024-01-24T15:31:49.600 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 150/161 2024-01-24T15:31:49.600 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/161 2024-01-24T15:31:49.963 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/161 2024-01-24T15:31:50.239 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 152/161 2024-01-24T15:31:50.491 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 153/161 2024-01-24T15:31:50.798 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 154/161 2024-01-24T15:31:50.798 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 155/161 2024-01-24T15:31:51.141 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 155/161 2024-01-24T15:31:51.141 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 156/161 2024-01-24T15:31:51.491 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 156/161 2024-01-24T15:31:51.491 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 157/161 2024-01-24T15:31:51.816 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 157/161 2024-01-24T15:31:51.816 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 158/161 2024-01-24T15:31:53.407 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 158/161 2024-01-24T15:31:53.408 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 159/161 2024-01-24T15:31:53.724 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 159/161 2024-01-24T15:31:53.923 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 160/161 2024-01-24T15:31:53.924 INFO:teuthology.orchestra.run.smithi204.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 161/161 2024-01-24T15:31:54.574 INFO:teuthology.orchestra.run.smithi204.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 161/161 2024-01-24T15:31:54.575 INFO:teuthology.orchestra.run.smithi204.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-01-24T15:31:54.575 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-01-24T15:31:55.255 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-2:18.2.1-341.g4e3182a6.el8.x86_64 1/161 2024-01-24T15:31:55.255 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-base-2:18.2.1-341.g4e3182a6.el8.x86_64 2/161 2024-01-24T15:31:55.255 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-common-2:18.2.1-341.g4e3182a6.el8.x86_64 3/161 2024-01-24T15:31:55.255 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-fuse-2:18.2.1-341.g4e3182a6.el8.x86_64 4/161 2024-01-24T15:31:55.256 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-immutable-object-cache-2:18.2.1-341.g4e3182 5/161 2024-01-24T15:31:55.256 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mds-2:18.2.1-341.g4e3182a6.el8.x86_64 6/161 2024-01-24T15:31:55.256 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-2:18.2.1-341.g4e3182a6.el8.x86_64 7/161 2024-01-24T15:31:55.256 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mon-2:18.2.1-341.g4e3182a6.el8.x86_64 8/161 2024-01-24T15:31:55.256 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-osd-2:18.2.1-341.g4e3182a6.el8.x86_64 9/161 2024-01-24T15:31:55.256 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-radosgw-2:18.2.1-341.g4e3182a6.el8.x86_64 10/161 2024-01-24T15:31:55.256 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-selinux-2:18.2.1-341.g4e3182a6.el8.x86_64 11/161 2024-01-24T15:31:55.256 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-test-2:18.2.1-341.g4e3182a6.el8.x86_64 12/161 2024-01-24T15:31:55.256 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephfs-mirror-2:18.2.1-341.g4e3182a6.el8.x86_64 13/161 2024-01-24T15:31:55.256 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephfs-devel-2:18.2.1-341.g4e3182a6.el8.x86_6 14/161 2024-01-24T15:31:55.256 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephfs2-2:18.2.1-341.g4e3182a6.el8.x86_64 15/161 2024-01-24T15:31:55.256 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcephsqlite-2:18.2.1-341.g4e3182a6.el8.x86_64 16/161 2024-01-24T15:31:55.256 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados-devel-2:18.2.1-341.g4e3182a6.el8.x86_64 17/161 2024-01-24T15:31:55.256 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libradosstriper1-2:18.2.1-341.g4e3182a6.el8.x86_ 18/161 2024-01-24T15:31:55.257 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librgw2-2:18.2.1-341.g4e3182a6.el8.x86_64 19/161 2024-01-24T15:31:55.257 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ceph-argparse-2:18.2.1-341.g4e3182a6.el8 20/161 2024-01-24T15:31:55.257 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-ceph-common-2:18.2.1-341.g4e3182a6.el8.x 21/161 2024-01-24T15:31:55.257 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cephfs-2:18.2.1-341.g4e3182a6.el8.x86_64 22/161 2024-01-24T15:31:55.257 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rados-2:18.2.1-341.g4e3182a6.el8.x86_64 23/161 2024-01-24T15:31:55.257 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rbd-2:18.2.1-341.g4e3182a6.el8.x86_64 24/161 2024-01-24T15:31:55.257 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rgw-2:18.2.1-341.g4e3182a6.el8.x86_64 25/161 2024-01-24T15:31:55.257 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-fuse-2:18.2.1-341.g4e3182a6.el8.x86_64 26/161 2024-01-24T15:31:55.257 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-mirror-2:18.2.1-341.g4e3182a6.el8.x86_64 27/161 2024-01-24T15:31:55.269 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : rbd-nbd-2:18.2.1-341.g4e3182a6.el8.x86_64 28/161 2024-01-24T15:31:55.270 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-grafana-dashboards-2:18.2.1-341.g4e3182a6.e 29/161 2024-01-24T15:31:55.270 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-cephadm-2:18.2.1-341.g4e3182a6.el8.noar 30/161 2024-01-24T15:31:55.270 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-dashboard-2:18.2.1-341.g4e3182a6.el8.no 31/161 2024-01-24T15:31:55.270 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.1-341.g4e31 32/161 2024-01-24T15:31:55.270 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-modules-core-2:18.2.1-341.g4e3182a6.el8 33/161 2024-01-24T15:31:55.270 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-mgr-rook-2:18.2.1-341.g4e3182a6.el8.noarch 34/161 2024-01-24T15:31:55.270 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-prometheus-alerts-2:18.2.1-341.g4e3182a6.el 35/161 2024-01-24T15:31:55.270 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : ceph-volume-2:18.2.1-341.g4e3182a6.el8.noarch 36/161 2024-01-24T15:31:55.270 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephadm-2:18.2.1-341.g4e3182a6.el8.noarch 37/161 2024-01-24T15:31:55.270 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : cephfs-top-2:18.2.1-341.g4e3182a6.el8.noarch 38/161 2024-01-24T15:31:55.270 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/161 2024-01-24T15:31:55.270 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/161 2024-01-24T15:31:55.270 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/161 2024-01-24T15:31:55.271 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/161 2024-01-24T15:31:55.271 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/161 2024-01-24T15:31:55.271 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/161 2024-01-24T15:31:55.271 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/161 2024-01-24T15:31:55.271 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/161 2024-01-24T15:31:55.271 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/161 2024-01-24T15:31:55.271 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/161 2024-01-24T15:31:55.271 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/161 2024-01-24T15:31:55.271 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/161 2024-01-24T15:31:55.271 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/161 2024-01-24T15:31:55.271 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/161 2024-01-24T15:31:55.271 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/161 2024-01-24T15:31:55.271 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/161 2024-01-24T15:31:55.271 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/161 2024-01-24T15:31:55.272 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/161 2024-01-24T15:31:55.272 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/161 2024-01-24T15:31:55.272 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/161 2024-01-24T15:31:55.272 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/161 2024-01-24T15:31:55.272 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/161 2024-01-24T15:31:55.272 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/161 2024-01-24T15:31:55.272 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/161 2024-01-24T15:31:55.272 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/161 2024-01-24T15:31:55.272 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/161 2024-01-24T15:31:55.272 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/161 2024-01-24T15:31:55.272 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/161 2024-01-24T15:31:55.272 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/161 2024-01-24T15:31:55.272 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/161 2024-01-24T15:31:55.272 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/161 2024-01-24T15:31:55.273 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/161 2024-01-24T15:31:55.273 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/161 2024-01-24T15:31:55.273 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 72/161 2024-01-24T15:31:55.273 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/161 2024-01-24T15:31:55.273 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/161 2024-01-24T15:31:55.273 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 75/161 2024-01-24T15:31:55.273 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/161 2024-01-24T15:31:55.273 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 77/161 2024-01-24T15:31:55.273 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 78/161 2024-01-24T15:31:55.273 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 79/161 2024-01-24T15:31:55.273 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/161 2024-01-24T15:31:55.273 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 81/161 2024-01-24T15:31:55.273 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 82/161 2024-01-24T15:31:55.273 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 83/161 2024-01-24T15:31:55.274 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 84/161 2024-01-24T15:31:55.274 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 85/161 2024-01-24T15:31:55.274 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 86/161 2024-01-24T15:31:55.274 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 87/161 2024-01-24T15:31:55.274 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 88/161 2024-01-24T15:31:55.274 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 89/161 2024-01-24T15:31:55.274 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 90/161 2024-01-24T15:31:55.274 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 91/161 2024-01-24T15:31:55.274 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 92/161 2024-01-24T15:31:55.274 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 93/161 2024-01-24T15:31:55.274 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 94/161 2024-01-24T15:31:55.274 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 95/161 2024-01-24T15:31:55.274 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 96/161 2024-01-24T15:31:55.274 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 97/161 2024-01-24T15:31:55.275 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-13.e 98/161 2024-01-24T15:31:55.275 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 99/161 2024-01-24T15:31:55.275 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 100/161 2024-01-24T15:31:55.275 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 101/161 2024-01-24T15:31:55.275 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 102/161 2024-01-24T15:31:55.275 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 103/161 2024-01-24T15:31:55.275 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 104/161 2024-01-24T15:31:55.275 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : bison-3.0.4-10.el8.x86_64 105/161 2024-01-24T15:31:55.275 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : flex-2.6.1-9.el8.x86_64 106/161 2024-01-24T15:31:55.275 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 107/161 2024-01-24T15:31:55.275 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 108/161 2024-01-24T15:31:55.275 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 109/161 2024-01-24T15:31:55.275 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 110/161 2024-01-24T15:31:55.275 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 111/161 2024-01-24T15:31:55.275 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 112/161 2024-01-24T15:31:55.276 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 113/161 2024-01-24T15:31:55.276 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 114/161 2024-01-24T15:31:55.276 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 115/161 2024-01-24T15:31:55.276 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 116/161 2024-01-24T15:31:55.276 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 117/161 2024-01-24T15:31:55.276 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 118/161 2024-01-24T15:31:55.276 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 119/161 2024-01-24T15:31:55.276 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 120/161 2024-01-24T15:31:55.276 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 121/161 2024-01-24T15:31:55.276 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : automake-1.16.1-8.el8.noarch 122/161 2024-01-24T15:31:55.276 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libpq-13.11-1.el8.x86_64 123/161 2024-01-24T15:31:55.276 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : jq-1.6-7.el8.x86_64 124/161 2024-01-24T15:31:55.276 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 125/161 2024-01-24T15:31:55.276 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : postgresql-10.23-3.module+el8.9.0+20831+78489779 126/161 2024-01-24T15:31:55.277 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : postgresql-contrib-10.23-3.module+el8.9.0+20831+ 127/161 2024-01-24T15:31:55.277 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : postgresql-server-10.23-3.module+el8.9.0+20831+7 128/161 2024-01-24T15:31:55.277 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 129/161 2024-01-24T15:31:55.277 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados2-2:18.2.1-341.g4e3182a6.el8.x86_64 130/161 2024-01-24T15:31:55.277 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 131/161 2024-01-24T15:31:55.277 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librbd1-2:18.2.1-341.g4e3182a6.el8.x86_64 132/161 2024-01-24T15:31:55.277 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 133/161 2024-01-24T15:31:55.277 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 134/161 2024-01-24T15:31:55.277 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 135/161 2024-01-24T15:31:55.277 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 136/161 2024-01-24T15:31:55.277 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 137/161 2024-01-24T15:31:55.277 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 138/161 2024-01-24T15:31:55.277 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 139/161 2024-01-24T15:31:55.277 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 140/161 2024-01-24T15:31:55.277 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 141/161 2024-01-24T15:31:55.278 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 142/161 2024-01-24T15:31:55.278 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 143/161 2024-01-24T15:31:55.278 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 144/161 2024-01-24T15:31:55.278 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 145/161 2024-01-24T15:31:55.278 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 146/161 2024-01-24T15:31:55.278 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 147/161 2024-01-24T15:31:55.278 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 148/161 2024-01-24T15:31:55.278 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 149/161 2024-01-24T15:31:55.278 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 150/161 2024-01-24T15:31:55.278 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 151/161 2024-01-24T15:31:55.278 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 152/161 2024-01-24T15:31:55.278 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 153/161 2024-01-24T15:31:55.278 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 154/161 2024-01-24T15:31:55.278 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 155/161 2024-01-24T15:31:55.279 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 156/161 2024-01-24T15:31:55.279 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 157/161 2024-01-24T15:31:55.279 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 158/161 2024-01-24T15:31:55.279 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 159/161 2024-01-24T15:31:55.279 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 160/161 2024-01-24T15:31:59.545 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 161/161 2024-01-24T15:31:59.545 INFO:teuthology.orchestra.run.smithi160.stdout:Installed products updated. 2024-01-24T15:32:00.168 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-01-24T15:32:00.168 INFO:teuthology.orchestra.run.smithi160.stdout:Upgraded: 2024-01-24T15:32:00.168 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-01-24T15:32:00.168 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-01-24T15:32:00.168 INFO:teuthology.orchestra.run.smithi160.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-01-24T15:32:00.168 INFO:teuthology.orchestra.run.smithi160.stdout: libblkid-2.32.1-43.el8.x86_64 2024-01-24T15:32:00.168 INFO:teuthology.orchestra.run.smithi160.stdout: libfdisk-2.32.1-43.el8.x86_64 2024-01-24T15:32:00.169 INFO:teuthology.orchestra.run.smithi160.stdout: libmount-2.32.1-43.el8.x86_64 2024-01-24T15:32:00.169 INFO:teuthology.orchestra.run.smithi160.stdout: librados2-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.169 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.169 INFO:teuthology.orchestra.run.smithi160.stdout: libsmartcols-2.32.1-43.el8.x86_64 2024-01-24T15:32:00.169 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-2.32.1-43.el8.x86_64 2024-01-24T15:32:00.169 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-01-24T15:32:00.169 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-01-24T15:32:00.169 INFO:teuthology.orchestra.run.smithi160.stdout: util-linux-2.32.1-43.el8.x86_64 2024-01-24T15:32:00.169 INFO:teuthology.orchestra.run.smithi160.stdout: util-linux-user-2.32.1-43.el8.x86_64 2024-01-24T15:32:00.169 INFO:teuthology.orchestra.run.smithi160.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-01-24T15:32:00.169 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-01-24T15:32:00.169 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-01-24T15:32:00.169 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-initscripts-updown-1:1.40.16-13.el8_9.noarch 2024-01-24T15:32:00.170 INFO:teuthology.orchestra.run.smithi160.stdout: automake-1.16.1-8.el8.noarch 2024-01-24T15:32:00.170 INFO:teuthology.orchestra.run.smithi160.stdout: bison-3.0.4-10.el8.x86_64 2024-01-24T15:32:00.170 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.170 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.170 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.170 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.170 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:00.170 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.170 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.170 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.170 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:00.170 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:00.170 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:00.171 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:00.171 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:00.171 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.171 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.171 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:00.171 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.171 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.171 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.171 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:00.171 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:00.171 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.171 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-top-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:00.171 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-01-24T15:32:00.171 INFO:teuthology.orchestra.run.smithi160.stdout: flex-2.6.1-9.el8.x86_64 2024-01-24T15:32:00.172 INFO:teuthology.orchestra.run.smithi160.stdout: fuse-2.9.7-17.el8.x86_64 2024-01-24T15:32:00.172 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-01-24T15:32:00.172 INFO:teuthology.orchestra.run.smithi160.stdout: jq-1.6-7.el8.x86_64 2024-01-24T15:32:00.172 INFO:teuthology.orchestra.run.smithi160.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-01-24T15:32:00.172 INFO:teuthology.orchestra.run.smithi160.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-01-24T15:32:00.172 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-01-24T15:32:00.172 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.172 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.172 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.172 INFO:teuthology.orchestra.run.smithi160.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-01-24T15:32:00.172 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-01-24T15:32:00.172 INFO:teuthology.orchestra.run.smithi160.stdout: liboath-2.6.2-3.el8.x86_64 2024-01-24T15:32:00.172 INFO:teuthology.orchestra.run.smithi160.stdout: libpq-13.11-1.el8.x86_64 2024-01-24T15:32:00.173 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-01-24T15:32:00.173 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq-0.9.0-4.el8.x86_64 2024-01-24T15:32:00.173 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.173 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.173 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-01-24T15:32:00.173 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.173 INFO:teuthology.orchestra.run.smithi160.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-01-24T15:32:00.173 INFO:teuthology.orchestra.run.smithi160.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-01-24T15:32:00.173 INFO:teuthology.orchestra.run.smithi160.stdout: libtool-2.4.6-25.el8.x86_64 2024-01-24T15:32:00.173 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind-1.3.1-3.el8.x86_64 2024-01-24T15:32:00.173 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2024-01-24T15:32:00.173 INFO:teuthology.orchestra.run.smithi160.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-01-24T15:32:00.173 INFO:teuthology.orchestra.run.smithi160.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-01-24T15:32:00.173 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-01-24T15:32:00.174 INFO:teuthology.orchestra.run.smithi160.stdout: oniguruma-6.8.2-2.el8.x86_64 2024-01-24T15:32:00.174 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-0.3.15-6.el8.x86_64 2024-01-24T15:32:00.174 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-01-24T15:32:00.174 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-01-24T15:32:00.174 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-01-24T15:32:00.174 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-01-24T15:32:00.174 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-01-24T15:32:00.174 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-10.23-3.module+el8.9.0+20831+78489779.x86_64 2024-01-24T15:32:00.174 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-contrib-10.23-3.module+el8.9.0+20831+78489779.x86_64 2024-01-24T15:32:00.174 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-server-10.23-3.module+el8.9.0+20831+78489779.x86_64 2024-01-24T15:32:00.174 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-01-24T15:32:00.174 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel-2.5.1-7.el8.noarch 2024-01-24T15:32:00.174 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-01-24T15:32:00.174 INFO:teuthology.orchestra.run.smithi160.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-01-24T15:32:00.175 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-01-24T15:32:00.175 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.175 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.175 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.175 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-01-24T15:32:00.175 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-01-24T15:32:00.175 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-01-24T15:32:00.175 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-01-24T15:32:00.175 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2024-01-24T15:32:00.175 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-01-24T15:32:00.175 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-6.2-6.el8.noarch 2024-01-24T15:32:00.175 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-01-24T15:32:00.175 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-01-24T15:32:00.176 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-01-24T15:32:00.176 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-01-24T15:32:00.176 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-01-24T15:32:00.176 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-01-24T15:32:00.176 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-01-24T15:32:00.176 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako-1.0.6-14.el8.noarch 2024-01-24T15:32:00.176 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-01-24T15:32:00.176 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-01-24T15:32:00.176 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-01-24T15:32:00.176 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-01-24T15:32:00.176 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-01-24T15:32:00.176 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-01-24T15:32:00.176 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-01-24T15:32:00.177 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend-2.6-1.el8.noarch 2024-01-24T15:32:00.177 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-01-24T15:32:00.177 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-01-24T15:32:00.177 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-01-24T15:32:00.177 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-01-24T15:32:00.177 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser-2.14-14.el8.noarch 2024-01-24T15:32:00.177 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz-2017.2-11.el8.noarch 2024-01-24T15:32:00.177 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.177 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.177 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-01-24T15:32:00.177 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-01-24T15:32:00.177 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.177 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes-2.4.1-12.el8.noarch 2024-01-24T15:32:00.177 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa-4.9-2.el8.noarch 2024-01-24T15:32:00.178 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-01-24T15:32:00.178 INFO:teuthology.orchestra.run.smithi160.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-01-24T15:32:00.178 INFO:teuthology.orchestra.run.smithi160.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-01-24T15:32:00.178 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-01-24T15:32:00.178 INFO:teuthology.orchestra.run.smithi160.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-01-24T15:32:00.178 INFO:teuthology.orchestra.run.smithi160.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-01-24T15:32:00.178 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-01-24T15:32:00.178 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-01-24T15:32:00.178 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-01-24T15:32:00.178 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-01-24T15:32:00.178 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-01-24T15:32:00.178 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.178 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.178 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:00.179 INFO:teuthology.orchestra.run.smithi160.stdout: socat-1.7.4.1-1.el8.x86_64 2024-01-24T15:32:00.179 INFO:teuthology.orchestra.run.smithi160.stdout: thrift-0.13.0-2.el8.x86_64 2024-01-24T15:32:00.179 INFO:teuthology.orchestra.run.smithi160.stdout: uuid-1.6.2-43.el8.x86_64 2024-01-24T15:32:00.179 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-01-24T15:32:00.179 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-01-24T15:32:00.179 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-01-24T15:32:00.179 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-01-24T15:32:00.179 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-01-24T15:32:00.534 DEBUG:teuthology.parallel:result is None 2024-01-24T15:32:04.062 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 161/161 2024-01-24T15:32:04.062 INFO:teuthology.orchestra.run.smithi005.stdout:Installed products updated. 2024-01-24T15:32:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:32:04.728 INFO:teuthology.orchestra.run.smithi005.stdout:Upgraded: 2024-01-24T15:32:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-01-24T15:32:04.728 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-01-24T15:32:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-01-24T15:32:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: libblkid-2.32.1-43.el8.x86_64 2024-01-24T15:32:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: libfdisk-2.32.1-43.el8.x86_64 2024-01-24T15:32:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: libmount-2.32.1-43.el8.x86_64 2024-01-24T15:32:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: librados2-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: libsmartcols-2.32.1-43.el8.x86_64 2024-01-24T15:32:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-2.32.1-43.el8.x86_64 2024-01-24T15:32:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-01-24T15:32:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-01-24T15:32:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: util-linux-2.32.1-43.el8.x86_64 2024-01-24T15:32:04.729 INFO:teuthology.orchestra.run.smithi005.stdout: util-linux-user-2.32.1-43.el8.x86_64 2024-01-24T15:32:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-01-24T15:32:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-01-24T15:32:04.730 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-01-24T15:32:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-initscripts-updown-1:1.40.16-13.el8_9.noarch 2024-01-24T15:32:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: automake-1.16.1-8.el8.noarch 2024-01-24T15:32:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: bison-3.0.4-10.el8.x86_64 2024-01-24T15:32:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.730 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.731 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-01-24T15:32:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: flex-2.6.1-9.el8.x86_64 2024-01-24T15:32:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: fuse-2.9.7-17.el8.x86_64 2024-01-24T15:32:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-01-24T15:32:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: jq-1.6-7.el8.x86_64 2024-01-24T15:32:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-01-24T15:32:04.732 INFO:teuthology.orchestra.run.smithi005.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-01-24T15:32:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-01-24T15:32:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-01-24T15:32:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-01-24T15:32:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: liboath-2.6.2-3.el8.x86_64 2024-01-24T15:32:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: libpq-13.11-1.el8.x86_64 2024-01-24T15:32:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-01-24T15:32:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq-0.9.0-4.el8.x86_64 2024-01-24T15:32:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.733 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-01-24T15:32:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-01-24T15:32:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-01-24T15:32:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: libtool-2.4.6-25.el8.x86_64 2024-01-24T15:32:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind-1.3.1-3.el8.x86_64 2024-01-24T15:32:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2024-01-24T15:32:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-01-24T15:32:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-01-24T15:32:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-01-24T15:32:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: oniguruma-6.8.2-2.el8.x86_64 2024-01-24T15:32:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-0.3.15-6.el8.x86_64 2024-01-24T15:32:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-01-24T15:32:04.734 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-01-24T15:32:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-01-24T15:32:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-01-24T15:32:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-01-24T15:32:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-10.23-3.module+el8.9.0+20831+78489779.x86_64 2024-01-24T15:32:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib-10.23-3.module+el8.9.0+20831+78489779.x86_64 2024-01-24T15:32:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server-10.23-3.module+el8.9.0+20831+78489779.x86_64 2024-01-24T15:32:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-01-24T15:32:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel-2.5.1-7.el8.noarch 2024-01-24T15:32:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-01-24T15:32:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-01-24T15:32:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-01-24T15:32:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.735 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-01-24T15:32:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-01-24T15:32:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-01-24T15:32:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-01-24T15:32:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2024-01-24T15:32:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-01-24T15:32:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-6.2-6.el8.noarch 2024-01-24T15:32:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-01-24T15:32:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-01-24T15:32:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-01-24T15:32:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-01-24T15:32:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-01-24T15:32:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-01-24T15:32:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-01-24T15:32:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako-1.0.6-14.el8.noarch 2024-01-24T15:32:04.736 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-01-24T15:32:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-01-24T15:32:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-01-24T15:32:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-01-24T15:32:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-01-24T15:32:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-01-24T15:32:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-01-24T15:32:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend-2.6-1.el8.noarch 2024-01-24T15:32:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-01-24T15:32:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-01-24T15:32:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-01-24T15:32:04.737 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-01-24T15:32:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser-2.14-14.el8.noarch 2024-01-24T15:32:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz-2017.2-11.el8.noarch 2024-01-24T15:32:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-01-24T15:32:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-01-24T15:32:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes-2.4.1-12.el8.noarch 2024-01-24T15:32:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa-4.9-2.el8.noarch 2024-01-24T15:32:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-01-24T15:32:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-01-24T15:32:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-01-24T15:32:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-01-24T15:32:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-01-24T15:32:04.738 INFO:teuthology.orchestra.run.smithi005.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-01-24T15:32:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-01-24T15:32:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-01-24T15:32:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-01-24T15:32:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-01-24T15:32:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-01-24T15:32:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: socat-1.7.4.1-1.el8.x86_64 2024-01-24T15:32:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: thrift-0.13.0-2.el8.x86_64 2024-01-24T15:32:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: uuid-1.6.2-43.el8.x86_64 2024-01-24T15:32:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-01-24T15:32:04.739 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-01-24T15:32:04.740 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-01-24T15:32:04.740 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:32:04.740 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-01-24T15:32:05.097 DEBUG:teuthology.parallel:result is None 2024-01-24T15:32:09.118 INFO:teuthology.orchestra.run.smithi204.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 161/161 2024-01-24T15:32:09.118 INFO:teuthology.orchestra.run.smithi204.stdout:Installed products updated. 2024-01-24T15:32:09.754 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-01-24T15:32:09.754 INFO:teuthology.orchestra.run.smithi204.stdout:Upgraded: 2024-01-24T15:32:09.754 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-01-24T15:32:09.754 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-01-24T15:32:09.754 INFO:teuthology.orchestra.run.smithi204.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-01-24T15:32:09.754 INFO:teuthology.orchestra.run.smithi204.stdout: libblkid-2.32.1-43.el8.x86_64 2024-01-24T15:32:09.754 INFO:teuthology.orchestra.run.smithi204.stdout: libfdisk-2.32.1-43.el8.x86_64 2024-01-24T15:32:09.754 INFO:teuthology.orchestra.run.smithi204.stdout: libmount-2.32.1-43.el8.x86_64 2024-01-24T15:32:09.754 INFO:teuthology.orchestra.run.smithi204.stdout: librados2-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.754 INFO:teuthology.orchestra.run.smithi204.stdout: librbd1-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.755 INFO:teuthology.orchestra.run.smithi204.stdout: libsmartcols-2.32.1-43.el8.x86_64 2024-01-24T15:32:09.755 INFO:teuthology.orchestra.run.smithi204.stdout: libuuid-2.32.1-43.el8.x86_64 2024-01-24T15:32:09.755 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-01-24T15:32:09.755 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-01-24T15:32:09.755 INFO:teuthology.orchestra.run.smithi204.stdout: util-linux-2.32.1-43.el8.x86_64 2024-01-24T15:32:09.755 INFO:teuthology.orchestra.run.smithi204.stdout: util-linux-user-2.32.1-43.el8.x86_64 2024-01-24T15:32:09.755 INFO:teuthology.orchestra.run.smithi204.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-01-24T15:32:09.755 INFO:teuthology.orchestra.run.smithi204.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-01-24T15:32:09.755 INFO:teuthology.orchestra.run.smithi204.stdout:Installed: 2024-01-24T15:32:09.755 INFO:teuthology.orchestra.run.smithi204.stdout: NetworkManager-initscripts-updown-1:1.40.16-13.el8_9.noarch 2024-01-24T15:32:09.755 INFO:teuthology.orchestra.run.smithi204.stdout: automake-1.16.1-8.el8.noarch 2024-01-24T15:32:09.755 INFO:teuthology.orchestra.run.smithi204.stdout: bison-3.0.4-10.el8.x86_64 2024-01-24T15:32:09.755 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.755 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-base-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.756 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-common-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.756 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-fuse-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.756 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-grafana-dashboards-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:09.756 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-immutable-object-cache-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.756 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mds-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.756 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.756 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-cephadm-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:09.756 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-dashboard-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:09.756 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-diskprediction-local-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:09.756 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-modules-core-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:09.756 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mgr-rook-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:09.756 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-mon-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.756 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-osd-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.756 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-prometheus-alerts-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:09.757 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-radosgw-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.757 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-selinux-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.757 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-test-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.757 INFO:teuthology.orchestra.run.smithi204.stdout: ceph-volume-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:09.757 INFO:teuthology.orchestra.run.smithi204.stdout: cephadm-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:09.757 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-mirror-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.757 INFO:teuthology.orchestra.run.smithi204.stdout: cephfs-top-2:18.2.1-341.g4e3182a6.el8.noarch 2024-01-24T15:32:09.757 INFO:teuthology.orchestra.run.smithi204.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-01-24T15:32:09.757 INFO:teuthology.orchestra.run.smithi204.stdout: flex-2.6.1-9.el8.x86_64 2024-01-24T15:32:09.757 INFO:teuthology.orchestra.run.smithi204.stdout: fuse-2.9.7-17.el8.x86_64 2024-01-24T15:32:09.757 INFO:teuthology.orchestra.run.smithi204.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-01-24T15:32:09.757 INFO:teuthology.orchestra.run.smithi204.stdout: jq-1.6-7.el8.x86_64 2024-01-24T15:32:09.757 INFO:teuthology.orchestra.run.smithi204.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-01-24T15:32:09.757 INFO:teuthology.orchestra.run.smithi204.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-01-24T15:32:09.758 INFO:teuthology.orchestra.run.smithi204.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-01-24T15:32:09.758 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs-devel-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.758 INFO:teuthology.orchestra.run.smithi204.stdout: libcephfs2-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.758 INFO:teuthology.orchestra.run.smithi204.stdout: libcephsqlite-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.758 INFO:teuthology.orchestra.run.smithi204.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-01-24T15:32:09.758 INFO:teuthology.orchestra.run.smithi204.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-01-24T15:32:09.758 INFO:teuthology.orchestra.run.smithi204.stdout: liboath-2.6.2-3.el8.x86_64 2024-01-24T15:32:09.758 INFO:teuthology.orchestra.run.smithi204.stdout: libpq-13.11-1.el8.x86_64 2024-01-24T15:32:09.758 INFO:teuthology.orchestra.run.smithi204.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-01-24T15:32:09.758 INFO:teuthology.orchestra.run.smithi204.stdout: librabbitmq-0.9.0-4.el8.x86_64 2024-01-24T15:32:09.758 INFO:teuthology.orchestra.run.smithi204.stdout: librados-devel-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.758 INFO:teuthology.orchestra.run.smithi204.stdout: libradosstriper1-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.758 INFO:teuthology.orchestra.run.smithi204.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-01-24T15:32:09.758 INFO:teuthology.orchestra.run.smithi204.stdout: librgw2-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.759 INFO:teuthology.orchestra.run.smithi204.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-01-24T15:32:09.759 INFO:teuthology.orchestra.run.smithi204.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-01-24T15:32:09.759 INFO:teuthology.orchestra.run.smithi204.stdout: libtool-2.4.6-25.el8.x86_64 2024-01-24T15:32:09.759 INFO:teuthology.orchestra.run.smithi204.stdout: libunwind-1.3.1-3.el8.x86_64 2024-01-24T15:32:09.759 INFO:teuthology.orchestra.run.smithi204.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2024-01-24T15:32:09.759 INFO:teuthology.orchestra.run.smithi204.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-01-24T15:32:09.759 INFO:teuthology.orchestra.run.smithi204.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-01-24T15:32:09.759 INFO:teuthology.orchestra.run.smithi204.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-01-24T15:32:09.759 INFO:teuthology.orchestra.run.smithi204.stdout: oniguruma-6.8.2-2.el8.x86_64 2024-01-24T15:32:09.759 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-0.3.15-6.el8.x86_64 2024-01-24T15:32:09.759 INFO:teuthology.orchestra.run.smithi204.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-01-24T15:32:09.759 INFO:teuthology.orchestra.run.smithi204.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-01-24T15:32:09.759 INFO:teuthology.orchestra.run.smithi204.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-01-24T15:32:09.759 INFO:teuthology.orchestra.run.smithi204.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-01-24T15:32:09.760 INFO:teuthology.orchestra.run.smithi204.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-01-24T15:32:09.760 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-10.23-3.module+el8.9.0+20831+78489779.x86_64 2024-01-24T15:32:09.760 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-contrib-10.23-3.module+el8.9.0+20831+78489779.x86_64 2024-01-24T15:32:09.760 INFO:teuthology.orchestra.run.smithi204.stdout: postgresql-server-10.23-3.module+el8.9.0+20831+78489779.x86_64 2024-01-24T15:32:09.760 INFO:teuthology.orchestra.run.smithi204.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-01-24T15:32:09.760 INFO:teuthology.orchestra.run.smithi204.stdout: python3-babel-2.5.1-7.el8.noarch 2024-01-24T15:32:09.760 INFO:teuthology.orchestra.run.smithi204.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-01-24T15:32:09.760 INFO:teuthology.orchestra.run.smithi204.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-01-24T15:32:09.760 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-01-24T15:32:09.760 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-argparse-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.760 INFO:teuthology.orchestra.run.smithi204.stdout: python3-ceph-common-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.760 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cephfs-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.760 INFO:teuthology.orchestra.run.smithi204.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-01-24T15:32:09.760 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-01-24T15:32:09.761 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-01-24T15:32:09.761 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-01-24T15:32:09.761 INFO:teuthology.orchestra.run.smithi204.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2024-01-24T15:32:09.761 INFO:teuthology.orchestra.run.smithi204.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-01-24T15:32:09.761 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-6.2-6.el8.noarch 2024-01-24T15:32:09.761 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-01-24T15:32:09.761 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-01-24T15:32:09.761 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-01-24T15:32:09.761 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-01-24T15:32:09.761 INFO:teuthology.orchestra.run.smithi204.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-01-24T15:32:09.761 INFO:teuthology.orchestra.run.smithi204.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-01-24T15:32:09.761 INFO:teuthology.orchestra.run.smithi204.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-01-24T15:32:09.761 INFO:teuthology.orchestra.run.smithi204.stdout: python3-mako-1.0.6-14.el8.noarch 2024-01-24T15:32:09.761 INFO:teuthology.orchestra.run.smithi204.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-01-24T15:32:09.762 INFO:teuthology.orchestra.run.smithi204.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-01-24T15:32:09.762 INFO:teuthology.orchestra.run.smithi204.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-01-24T15:32:09.762 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-01-24T15:32:09.762 INFO:teuthology.orchestra.run.smithi204.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-01-24T15:32:09.762 INFO:teuthology.orchestra.run.smithi204.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-01-24T15:32:09.762 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-01-24T15:32:09.762 INFO:teuthology.orchestra.run.smithi204.stdout: python3-portend-2.6-1.el8.noarch 2024-01-24T15:32:09.762 INFO:teuthology.orchestra.run.smithi204.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-01-24T15:32:09.762 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-01-24T15:32:09.762 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-01-24T15:32:09.762 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-01-24T15:32:09.762 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pycparser-2.14-14.el8.noarch 2024-01-24T15:32:09.762 INFO:teuthology.orchestra.run.smithi204.stdout: python3-pytz-2017.2-11.el8.noarch 2024-01-24T15:32:09.762 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rados-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.763 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rbd-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.763 INFO:teuthology.orchestra.run.smithi204.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-01-24T15:32:09.763 INFO:teuthology.orchestra.run.smithi204.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-01-24T15:32:09.763 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rgw-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.763 INFO:teuthology.orchestra.run.smithi204.stdout: python3-routes-2.4.1-12.el8.noarch 2024-01-24T15:32:09.763 INFO:teuthology.orchestra.run.smithi204.stdout: python3-rsa-4.9-2.el8.noarch 2024-01-24T15:32:09.763 INFO:teuthology.orchestra.run.smithi204.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-01-24T15:32:09.763 INFO:teuthology.orchestra.run.smithi204.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-01-24T15:32:09.763 INFO:teuthology.orchestra.run.smithi204.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-01-24T15:32:09.763 INFO:teuthology.orchestra.run.smithi204.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-01-24T15:32:09.763 INFO:teuthology.orchestra.run.smithi204.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-01-24T15:32:09.763 INFO:teuthology.orchestra.run.smithi204.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-01-24T15:32:09.763 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-01-24T15:32:09.763 INFO:teuthology.orchestra.run.smithi204.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-01-24T15:32:09.763 INFO:teuthology.orchestra.run.smithi204.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-01-24T15:32:09.764 INFO:teuthology.orchestra.run.smithi204.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-01-24T15:32:09.764 INFO:teuthology.orchestra.run.smithi204.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-01-24T15:32:09.764 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-fuse-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.764 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-mirror-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.764 INFO:teuthology.orchestra.run.smithi204.stdout: rbd-nbd-2:18.2.1-341.g4e3182a6.el8.x86_64 2024-01-24T15:32:09.764 INFO:teuthology.orchestra.run.smithi204.stdout: socat-1.7.4.1-1.el8.x86_64 2024-01-24T15:32:09.764 INFO:teuthology.orchestra.run.smithi204.stdout: thrift-0.13.0-2.el8.x86_64 2024-01-24T15:32:09.764 INFO:teuthology.orchestra.run.smithi204.stdout: uuid-1.6.2-43.el8.x86_64 2024-01-24T15:32:09.764 INFO:teuthology.orchestra.run.smithi204.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-01-24T15:32:09.764 INFO:teuthology.orchestra.run.smithi204.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-01-24T15:32:09.765 INFO:teuthology.orchestra.run.smithi204.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-01-24T15:32:09.765 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-01-24T15:32:09.765 INFO:teuthology.orchestra.run.smithi204.stdout:Complete! 2024-01-24T15:32:10.143 DEBUG:teuthology.parallel:result is None 2024-01-24T15:32:10.143 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4e3182a65800aed6d4aa2f6b86da3cfd72188134 2024-01-24T15:32:10.307 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-24T15:32:10.365 INFO:teuthology.orchestra.run.smithi005.stdout:18.2.1-341.g4e3182a6.el8 2024-01-24T15:32:10.366 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-341.g4e3182a6.el8 2024-01-24T15:32:10.366 INFO:teuthology.task.install:The correct ceph version 18.2.1-341.g4e3182a6 is installed. 2024-01-24T15:32:10.368 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4e3182a65800aed6d4aa2f6b86da3cfd72188134 2024-01-24T15:32:10.581 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-24T15:32:10.639 INFO:teuthology.orchestra.run.smithi160.stdout:18.2.1-341.g4e3182a6.el8 2024-01-24T15:32:10.639 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-341.g4e3182a6.el8 2024-01-24T15:32:10.639 INFO:teuthology.task.install:The correct ceph version 18.2.1-341.g4e3182a6 is installed. 2024-01-24T15:32:10.641 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4e3182a65800aed6d4aa2f6b86da3cfd72188134 2024-01-24T15:32:10.860 DEBUG:teuthology.orchestra.run.smithi204:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-24T15:32:10.917 INFO:teuthology.orchestra.run.smithi204.stdout:18.2.1-341.g4e3182a6.el8 2024-01-24T15:32:10.917 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-341.g4e3182a6.el8 2024-01-24T15:32:10.918 INFO:teuthology.task.install:The correct ceph version 18.2.1-341.g4e3182a6 is installed. 2024-01-24T15:32:10.920 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-24T15:32:10.920 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-01-24T15:32:10.920 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-24T15:32:11.014 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-01-24T15:32:11.014 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-24T15:32:11.108 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-01-24T15:32:11.108 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-24T15:32:11.197 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-24T15:32:11.198 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-01-24T15:32:11.198 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/daemon-helper 2024-01-24T15:32:11.267 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-24T15:32:11.373 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-01-24T15:32:11.373 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/daemon-helper 2024-01-24T15:32:11.442 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-24T15:32:11.546 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-01-24T15:32:11.546 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/daemon-helper 2024-01-24T15:32:11.613 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-24T15:32:11.717 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-24T15:32:11.717 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-01-24T15:32:11.717 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-24T15:32:11.785 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-24T15:32:11.889 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-01-24T15:32:11.889 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-24T15:32:11.955 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-24T15:32:12.060 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-01-24T15:32:12.060 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-24T15:32:12.125 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-24T15:32:12.229 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-24T15:32:12.229 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-01-24T15:32:12.229 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/stdin-killer 2024-01-24T15:32:12.295 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-24T15:32:12.400 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-01-24T15:32:12.400 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/stdin-killer 2024-01-24T15:32:12.465 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-24T15:32:12.570 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-01-24T15:32:12.570 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/usr/bin/stdin-killer 2024-01-24T15:32:12.634 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-24T15:32:12.739 INFO:teuthology.run_tasks:Running task cephadm... 2024-01-24T15:32:12.834 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-01-24T15:32:12.834 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 2024-01-24T15:32:12.835 INFO:tasks.cephadm:Cluster fsid is bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:32:12.835 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-01-24T15:32:12.835 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.5', 'mon.b': '172.21.15.160', 'mon.c': '172.21.15.204'} 2024-01-24T15:32:12.835 INFO:tasks.cephadm:First mon is mon.a on smithi005 2024-01-24T15:32:12.835 INFO:tasks.cephadm:First mgr is x 2024-01-24T15:32:12.835 INFO:tasks.cephadm:Normalizing hostnames... 2024-01-24T15:32:12.835 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname $(hostname -s) 2024-01-24T15:32:12.902 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname $(hostname -s) 2024-01-24T15:32:12.969 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname $(hostname -s) 2024-01-24T15:32:13.036 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-01-24T15:32:13.037 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4e3182a65800aed6d4aa2f6b86da3cfd72188134 2024-01-24T15:32:13.253 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '4e3182a65800aed6d4aa2f6b86da3cfd72188134', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/76187/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.1-341-g4e3182a6', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.1-341.g4e3182a6'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2024-01-24 07:52:51.100568', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-vshankar-testing1-reef-2024-01-24-1150', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/centos/8/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-01-24T15:32:13.397 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-vshankar-testing1-reef-2024-01-24-1150, sha1 4e3182a65800aed6d4aa2f6b86da3cfd72188134 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=4e3182a65800aed6d4aa2f6b86da3cfd72188134 2024-01-24T15:32:13.398 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/centos/8/x86_64/flavors/default/cephadm 2024-01-24T15:32:13.398 DEBUG:teuthology.orchestra.run.smithi005:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-01-24T15:32:14.309 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-rw-r--. 1 ubuntu ubuntu 690687 Jan 24 15:32 /home/ubuntu/cephtest/cephadm 2024-01-24T15:32:14.310 DEBUG:teuthology.orchestra.run.smithi160:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-01-24T15:32:14.836 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-rw-r--. 1 ubuntu ubuntu 690687 Jan 24 15:32 /home/ubuntu/cephtest/cephadm 2024-01-24T15:32:14.836 DEBUG:teuthology.orchestra.run.smithi204:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-vshankar-testing1-reef-2024-01-24-1150/4e3182a65800aed6d4aa2f6b86da3cfd72188134/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-01-24T15:32:15.340 INFO:teuthology.orchestra.run.smithi204.stdout:-rw-rw-r--. 1 ubuntu ubuntu 690687 Jan 24 15:32 /home/ubuntu/cephtest/cephadm 2024-01-24T15:32:15.340 DEBUG:teuthology.orchestra.run.smithi005:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-01-24T15:32:15.389 DEBUG:teuthology.orchestra.run.smithi160:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-01-24T15:32:15.438 DEBUG:teuthology.orchestra.run.smithi204:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-01-24T15:32:15.501 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 on all hosts... 2024-01-24T15:32:15.502 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 pull 2024-01-24T15:32:15.506 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 pull 2024-01-24T15:32:15.510 DEBUG:teuthology.orchestra.run.smithi204:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 pull 2024-01-24T15:32:16.929 INFO:teuthology.orchestra.run.smithi005.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134... 2024-01-24T15:32:16.998 INFO:teuthology.orchestra.run.smithi160.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134... 2024-01-24T15:32:17.699 INFO:teuthology.orchestra.run.smithi204.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134... 2024-01-24T15:32:55.396 INFO:teuthology.orchestra.run.smithi204.stdout:{ 2024-01-24T15:32:55.397 INFO:teuthology.orchestra.run.smithi204.stdout: "ceph_version": "ceph version 18.2.1-341-g4e3182a6 (4e3182a65800aed6d4aa2f6b86da3cfd72188134) reef (stable)", 2024-01-24T15:32:55.397 INFO:teuthology.orchestra.run.smithi204.stdout: "image_id": "d650b791ad541e9330061e00985d36774db72ca0aaab13a27fd81b9f0f9eec74", 2024-01-24T15:32:55.397 INFO:teuthology.orchestra.run.smithi204.stdout: "repo_digests": [ 2024-01-24T15:32:55.397 INFO:teuthology.orchestra.run.smithi204.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:22efea2f35520d1212d406fc0d380a7fe7894a099a64f04365d740d4e7cb8285" 2024-01-24T15:32:55.397 INFO:teuthology.orchestra.run.smithi204.stdout: ] 2024-01-24T15:32:55.397 INFO:teuthology.orchestra.run.smithi204.stdout:} 2024-01-24T15:33:05.666 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-01-24T15:33:05.666 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 18.2.1-341-g4e3182a6 (4e3182a65800aed6d4aa2f6b86da3cfd72188134) reef (stable)", 2024-01-24T15:33:05.666 INFO:teuthology.orchestra.run.smithi005.stdout: "image_id": "d650b791ad541e9330061e00985d36774db72ca0aaab13a27fd81b9f0f9eec74", 2024-01-24T15:33:05.666 INFO:teuthology.orchestra.run.smithi005.stdout: "repo_digests": [ 2024-01-24T15:33:05.666 INFO:teuthology.orchestra.run.smithi005.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:22efea2f35520d1212d406fc0d380a7fe7894a099a64f04365d740d4e7cb8285" 2024-01-24T15:33:05.667 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-01-24T15:33:05.667 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-01-24T15:33:06.109 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-01-24T15:33:06.109 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_version": "ceph version 18.2.1-341-g4e3182a6 (4e3182a65800aed6d4aa2f6b86da3cfd72188134) reef (stable)", 2024-01-24T15:33:06.109 INFO:teuthology.orchestra.run.smithi160.stdout: "image_id": "d650b791ad541e9330061e00985d36774db72ca0aaab13a27fd81b9f0f9eec74", 2024-01-24T15:33:06.109 INFO:teuthology.orchestra.run.smithi160.stdout: "repo_digests": [ 2024-01-24T15:33:06.110 INFO:teuthology.orchestra.run.smithi160.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:22efea2f35520d1212d406fc0d380a7fe7894a099a64f04365d740d4e7cb8285" 2024-01-24T15:33:06.110 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-01-24T15:33:06.110 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-01-24T15:33:06.136 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph 2024-01-24T15:33:06.212 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /etc/ceph 2024-01-24T15:33:06.282 DEBUG:teuthology.orchestra.run.smithi204:> sudo mkdir -p /etc/ceph 2024-01-24T15:33:06.359 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /etc/ceph 2024-01-24T15:33:06.426 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 777 /etc/ceph 2024-01-24T15:33:06.491 DEBUG:teuthology.orchestra.run.smithi204:> sudo chmod 777 /etc/ceph 2024-01-24T15:33:06.560 INFO:tasks.cephadm:Writing seed config... 2024-01-24T15:33:06.561 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-01-24T15:33:06.561 INFO:tasks.cephadm: override: [client] debug client = 20 2024-01-24T15:33:06.561 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-01-24T15:33:06.561 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-01-24T15:33:06.562 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-01-24T15:33:06.562 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-01-24T15:33:06.562 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-01-24T15:33:06.562 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-01-24T15:33:06.562 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-01-24T15:33:06.562 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-01-24T15:33:06.562 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-01-24T15:33:06.562 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-01-24T15:33:06.562 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-01-24T15:33:06.562 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-01-24T15:33:06.562 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-01-24T15:33:06.562 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-01-24T15:33:06.562 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-01-24T15:33:06.562 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-01-24T15:33:06.562 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-01-24T15:33:06.563 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-01-24T15:33:06.563 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-01-24T15:33:06.563 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-01-24T15:33:06.563 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-01-24T15:33:06.563 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-01-24T15:33:06.563 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-01-24T15:33:06.563 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-01-24T15:33:06.563 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-01-24T15:33:06.563 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-01-24T15:33:06.563 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-01-24T15:33:06.563 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-01-24T15:33:06.563 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-01-24T15:33:06.563 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-01-24T15:33:06.563 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-01-24T15:33:06.563 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-01-24T15:33:06.564 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-01-24T15:33:06.564 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-01-24T15:33:06.564 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-01-24T15:33:06.564 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-01-24T15:33:06.564 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-01-24T15:33:06.564 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-01-24T15:33:06.564 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-01-24T15:33:06.564 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-01-24T15:33:06.564 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-01-24T15:33:06.564 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-01-24T15:33:06.564 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-01-24T15:33:06.564 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-01-24T15:33:06.564 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-01-24T15:33:06.565 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-01-24T15:33:06.565 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-01-24T15:33:06.606 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = bede0bb6-bacd-11ee-95b1-87774f69a715 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-01-24T15:33:06.607 DEBUG:teuthology.orchestra.run.smithi005:mon.a> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mon.a.service 2024-01-24T15:33:06.652 DEBUG:teuthology.orchestra.run.smithi005:mgr.x> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mgr.x.service 2024-01-24T15:33:06.696 INFO:tasks.cephadm:Bootstrapping... 2024-01-24T15:33:06.696 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 -v bootstrap --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.5 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-01-24T15:33:06.717 INFO:journalctl@ceph.mon.a.smithi005.stdout:-- Logs begin at Wed 2024-01-24 15:16:42 UTC. -- 2024-01-24T15:33:06.761 INFO:journalctl@ceph.mgr.x.smithi005.stdout:-- Logs begin at Wed 2024-01-24 15:16:42 UTC. -- 2024-01-24T15:33:06.918 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-01-24T15:33:06.919 INFO:teuthology.orchestra.run.smithi005.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134', '-v', 'bootstrap', '--fsid', 'bede0bb6-bacd-11ee-95b1-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.5', '--skip-admin-label'] 2024-01-24T15:33:06.964 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout 4.6.1 2024-01-24T15:33:06.965 INFO:teuthology.orchestra.run.smithi005.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-01-24T15:33:06.965 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying podman|docker is present... 2024-01-24T15:33:07.011 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout 4.6.1 2024-01-24T15:33:07.012 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying lvm2 is present... 2024-01-24T15:33:07.012 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying time synchronization is in place... 2024-01-24T15:33:07.025 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-01-24T15:33:07.025 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-01-24T15:33:07.038 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-01-24T15:33:07.038 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-01-24T15:33:07.051 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout enabled 2024-01-24T15:33:07.063 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout active 2024-01-24T15:33:07.063 INFO:teuthology.orchestra.run.smithi005.stdout:Unit chronyd.service is enabled and running 2024-01-24T15:33:07.063 INFO:teuthology.orchestra.run.smithi005.stdout:Repeating the final host check... 2024-01-24T15:33:07.106 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout 4.6.1 2024-01-24T15:33:07.106 INFO:teuthology.orchestra.run.smithi005.stdout:podman (/bin/podman) version 4.6.1 is present 2024-01-24T15:33:07.107 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl is present 2024-01-24T15:33:07.107 INFO:teuthology.orchestra.run.smithi005.stdout:lvcreate is present 2024-01-24T15:33:07.119 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-01-24T15:33:07.119 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-01-24T15:33:07.131 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-01-24T15:33:07.131 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-01-24T15:33:07.144 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout enabled 2024-01-24T15:33:07.157 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout active 2024-01-24T15:33:07.157 INFO:teuthology.orchestra.run.smithi005.stdout:Unit chronyd.service is enabled and running 2024-01-24T15:33:07.157 INFO:teuthology.orchestra.run.smithi005.stdout:Host looks OK 2024-01-24T15:33:07.157 INFO:teuthology.orchestra.run.smithi005.stdout:Cluster fsid: bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:33:07.158 INFO:teuthology.orchestra.run.smithi005.stdout:Acquiring lock 140359206840808 on /run/cephadm/bede0bb6-bacd-11ee-95b1-87774f69a715.lock 2024-01-24T15:33:07.158 INFO:teuthology.orchestra.run.smithi005.stdout:Lock 140359206840808 acquired on /run/cephadm/bede0bb6-bacd-11ee-95b1-87774f69a715.lock 2024-01-24T15:33:07.158 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying IP 172.21.15.5 port 3300 ... 2024-01-24T15:33:07.159 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying IP 172.21.15.5 port 6789 ... 2024-01-24T15:33:07.159 INFO:teuthology.orchestra.run.smithi005.stdout:Base mon IP(s) is [172.21.15.5:3300, 172.21.15.5:6789], mon addrv is [v2:172.21.15.5:3300,v1:172.21.15.5:6789] 2024-01-24T15:33:07.166 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp metric 100 2024-01-24T15:33:07.166 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.5 metric 100 2024-01-24T15:33:07.173 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-01-24T15:33:07.173 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-01-24T15:33:07.173 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1785sec hoplimit 64 pref medium 2024-01-24T15:33:07.180 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-01-24T15:33:07.180 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-01-24T15:33:07.180 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-01-24T15:33:07.180 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-01-24T15:33:07.180 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-01-24T15:33:07.180 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-01-24T15:33:07.181 INFO:teuthology.orchestra.run.smithi005.stdout:Mon IP `172.21.15.5` is in CIDR network `172.21.0.0/20` 2024-01-24T15:33:07.181 INFO:teuthology.orchestra.run.smithi005.stdout:Mon IP `172.21.15.5` is in CIDR network `172.21.0.0/20` 2024-01-24T15:33:07.181 INFO:teuthology.orchestra.run.smithi005.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-01-24T15:33:07.182 INFO:teuthology.orchestra.run.smithi005.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-01-24T15:33:07.183 INFO:teuthology.orchestra.run.smithi005.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134... 2024-01-24T15:33:07.602 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout d650b791ad541e9330061e00985d36774db72ca0aaab13a27fd81b9f0f9eec74 2024-01-24T15:33:07.603 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134... 2024-01-24T15:33:07.603 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Getting image source signatures 2024-01-24T15:33:07.603 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Copying blob sha256:5bd92459d7edc3325b5efa151665fd479e83585b213707287afb2af065f59941 2024-01-24T15:33:07.603 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Copying blob sha256:ea3366b8a90265ae3f6d3736cb0de4b52da4ffec919b46c6cb5bc5be1372efe8 2024-01-24T15:33:07.603 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Copying config sha256:d650b791ad541e9330061e00985d36774db72ca0aaab13a27fd81b9f0f9eec74 2024-01-24T15:33:07.603 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Writing manifest to image destination 2024-01-24T15:33:08.310 INFO:teuthology.orchestra.run.smithi005.stdout:ceph: stdout ceph version 18.2.1-341-g4e3182a6 (4e3182a65800aed6d4aa2f6b86da3cfd72188134) reef (stable) 2024-01-24T15:33:08.310 INFO:teuthology.orchestra.run.smithi005.stdout:Ceph version: ceph version 18.2.1-341-g4e3182a6 (4e3182a65800aed6d4aa2f6b86da3cfd72188134) reef (stable) 2024-01-24T15:33:08.310 INFO:teuthology.orchestra.run.smithi005.stdout:Extracting ceph user uid/gid from container image... 2024-01-24T15:33:08.896 INFO:teuthology.orchestra.run.smithi005.stdout:stat: stdout 167 167 2024-01-24T15:33:08.896 INFO:teuthology.orchestra.run.smithi005.stdout:Creating initial keys... 2024-01-24T15:33:09.468 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-authtool: stdout AQC1LbFlm57YCBAA5UweTvQ+kgz+03Fu/KQt2Q== 2024-01-24T15:33:10.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-authtool: stdout AQC1LbFl/ieaKxAAbUUPiX6oXxBNaazvJM5EWQ== 2024-01-24T15:33:10.617 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-authtool: stdout AQC2LbFlzn3DEhAAuBPIGBdgqXt96XpZGn6isg== 2024-01-24T15:33:10.618 INFO:teuthology.orchestra.run.smithi005.stdout:Creating initial monmap... 2024-01-24T15:33:11.219 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-01-24T15:33:11.219 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-01-24T15:33:11.219 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:33:11.219 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-01-24T15:33:11.219 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool for a [v2:172.21.15.5:3300,v1:172.21.15.5:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-01-24T15:33:11.219 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = pacific 2024-01-24T15:33:11.219 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: set fsid to bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:33:11.219 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-01-24T15:33:11.219 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:33:11.220 INFO:teuthology.orchestra.run.smithi005.stdout:Creating mon... 2024-01-24T15:33:11.825 INFO:teuthology.orchestra.run.smithi005.stdout:create mon.a on 2024-01-24T15:33:12.062 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-01-24T15:33:12.261 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-01-24T15:33:12.499 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-bede0bb6-bacd-11ee-95b1-87774f69a715.target → /etc/systemd/system/ceph-bede0bb6-bacd-11ee-95b1-87774f69a715.target. 2024-01-24T15:33:12.499 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-bede0bb6-bacd-11ee-95b1-87774f69a715.target → /etc/systemd/system/ceph-bede0bb6-bacd-11ee-95b1-87774f69a715.target. 2024-01-24T15:33:12.844 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mon.a 2024-01-24T15:33:12.845 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to reset failed state of unit ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mon.a.service: Unit ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mon.a.service not loaded. 2024-01-24T15:33:13.043 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-bede0bb6-bacd-11ee-95b1-87774f69a715.target.wants/ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mon.a.service → /etc/systemd/system/ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@.service. 2024-01-24T15:33:13.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:13 smithi005 systemd[1]: Starting Ceph mon.a for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:33:13.551 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-01-24T15:33:13.551 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2024-01-24T15:33:13.571 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-01-24T15:33:13.572 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-01-24T15:33:13.572 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2024-01-24T15:33:13.572 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to enable service . firewalld.service is not available 2024-01-24T15:33:13.572 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mon to start... 2024-01-24T15:33:13.572 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mon... 2024-01-24T15:33:13.576 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:13 smithi005 bash[34817]: 46e90f0292b702bd984e148ae0adeadcabc32f9312b87d24caadb97e2bbe120a 2024-01-24T15:33:13.576 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:13 smithi005 systemd[1]: Started Ceph mon.a for bede0bb6-bacd-11ee-95b1-87774f69a715. 2024-01-24T15:33:13.576 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:13 smithi005 ceph-mon[34855]: mkfs bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:33:13.802 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:13 smithi005 ceph-mon[34855]: mon.a is new leader, mons a in quorum (ranks 0) 2024-01-24T15:33:14.382 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout cluster: 2024-01-24T15:33:14.386 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout id: bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:33:14.386 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-01-24T15:33:14.386 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-01-24T15:33:14.386 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout services: 2024-01-24T15:33:14.386 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.508389s) 2024-01-24T15:33:14.386 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-01-24T15:33:14.386 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-01-24T15:33:14.386 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-01-24T15:33:14.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout data: 2024-01-24T15:33:14.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-01-24T15:33:14.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-01-24T15:33:14.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-01-24T15:33:14.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout pgs: 2024-01-24T15:33:14.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-01-24T15:33:14.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.987+0000 7f0705a00700 1 Processor -- start 2024-01-24T15:33:14.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.987+0000 7f0705a00700 1 -- start start 2024-01-24T15:33:14.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.988+0000 7f0705a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070007ad60 0x7f07000791c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:14.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.988+0000 7f0705a00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0700079790 con 0x7f070007ad60 2024-01-24T15:33:14.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.988+0000 7f06fea00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070007ad60 0x7f07000791c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:14.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.989+0000 7f06fea00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070007ad60 0x7f07000791c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52140/0 (socket says 172.21.15.5:52140) 2024-01-24T15:33:14.387 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.989+0000 7f06fea00700 1 -- 172.21.15.5:0/278746626 learned_addr learned my addr 172.21.15.5:0/278746626 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:14.388 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.989+0000 7f06fea00700 1 -- 172.21.15.5:0/278746626 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07000798d0 con 0x7f070007ad60 2024-01-24T15:33:14.388 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.989+0000 7f06fea00700 1 --2- 172.21.15.5:0/278746626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070007ad60 0x7f07000791c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f06f00098a0 tx=0x7f06f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ee153c41b331d5 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:14.388 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.989+0000 7f06fe000700 1 -- 172.21.15.5:0/278746626 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06f0004160 con 0x7f070007ad60 2024-01-24T15:33:14.388 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.990+0000 7f06fe000700 1 -- 172.21.15.5:0/278746626 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f00042c0 con 0x7f070007ad60 2024-01-24T15:33:14.388 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.990+0000 7f06fe000700 1 -- 172.21.15.5:0/278746626 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06f00045a0 con 0x7f070007ad60 2024-01-24T15:33:14.388 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.990+0000 7f0705a00700 1 -- 172.21.15.5:0/278746626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070007ad60 msgr2=0x7f07000791c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:14.388 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.990+0000 7f0705a00700 1 --2- 172.21.15.5:0/278746626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070007ad60 0x7f07000791c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f06f00098a0 tx=0x7f06f0009bb0 comp rx=0 tx=0).stop 2024-01-24T15:33:14.388 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.990+0000 7f0705a00700 1 -- 172.21.15.5:0/278746626 shutdown_connections 2024-01-24T15:33:14.388 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.990+0000 7f0705a00700 1 --2- 172.21.15.5:0/278746626 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070007ad60 0x7f07000791c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:14.388 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.990+0000 7f0705a00700 1 -- 172.21.15.5:0/278746626 >> 172.21.15.5:0/278746626 conn(0x7f0700101c00 msgr2=0x7f0700104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:14.390 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.990+0000 7f0705a00700 1 -- 172.21.15.5:0/278746626 shutdown_connections 2024-01-24T15:33:14.390 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.990+0000 7f0705a00700 1 -- 172.21.15.5:0/278746626 wait complete. 2024-01-24T15:33:14.390 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.991+0000 7f0705a00700 1 Processor -- start 2024-01-24T15:33:14.390 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.991+0000 7f0705a00700 1 -- start start 2024-01-24T15:33:14.390 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.992+0000 7f0705a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070007ad60 0x7f070019bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:14.391 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.992+0000 7f0705a00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070019c1e0 con 0x7f070007ad60 2024-01-24T15:33:14.391 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.992+0000 7f06fea00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070007ad60 0x7f070019bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:14.391 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.992+0000 7f06fea00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070007ad60 0x7f070019bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52146/0 (socket says 172.21.15.5:52146) 2024-01-24T15:33:14.391 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.992+0000 7f06fea00700 1 -- 172.21.15.5:0/3518217703 learned_addr learned my addr 172.21.15.5:0/3518217703 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:14.391 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.993+0000 7f06fea00700 1 -- 172.21.15.5:0/3518217703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f0009550 con 0x7f070007ad60 2024-01-24T15:33:14.391 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.993+0000 7f06fea00700 1 --2- 172.21.15.5:0/3518217703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070007ad60 0x7f070019bca0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f070007a230 tx=0x7f06f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:14.391 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.993+0000 7f06f7400700 1 -- 172.21.15.5:0/3518217703 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06f0011630 con 0x7f070007ad60 2024-01-24T15:33:14.391 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.993+0000 7f06f7400700 1 -- 172.21.15.5:0/3518217703 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f0011790 con 0x7f070007ad60 2024-01-24T15:33:14.391 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.993+0000 7f0705a00700 1 -- 172.21.15.5:0/3518217703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f070019c3e0 con 0x7f070007ad60 2024-01-24T15:33:14.391 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.993+0000 7f06f7400700 1 -- 172.21.15.5:0/3518217703 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06f0011a30 con 0x7f070007ad60 2024-01-24T15:33:14.391 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.993+0000 7f0705a00700 1 -- 172.21.15.5:0/3518217703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f070019c800 con 0x7f070007ad60 2024-01-24T15:33:14.391 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.994+0000 7f06f7400700 1 -- 172.21.15.5:0/3518217703 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f06f0022070 con 0x7f070007ad60 2024-01-24T15:33:14.392 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.994+0000 7f06f7400700 1 -- 172.21.15.5:0/3518217703 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f06f001c450 con 0x7f070007ad60 2024-01-24T15:33:14.392 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.994+0000 7f0705a00700 1 -- 172.21.15.5:0/3518217703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0700195c00 con 0x7f070007ad60 2024-01-24T15:33:14.392 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:13.998+0000 7f06f7400700 1 -- 172.21.15.5:0/3518217703 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f06f001b450 con 0x7f070007ad60 2024-01-24T15:33:14.392 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.073+0000 7f0705a00700 1 -- 172.21.15.5:0/3518217703 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f070002cc70 con 0x7f070007ad60 2024-01-24T15:33:14.392 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.074+0000 7f06f7400700 1 -- 172.21.15.5:0/3518217703 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f06f001b5f0 con 0x7f070007ad60 2024-01-24T15:33:14.392 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.074+0000 7f0705a00700 1 -- 172.21.15.5:0/3518217703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070007ad60 msgr2=0x7f070019bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:14.392 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.074+0000 7f0705a00700 1 --2- 172.21.15.5:0/3518217703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070007ad60 0x7f070019bca0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f070007a230 tx=0x7f06f0004750 comp rx=0 tx=0).stop 2024-01-24T15:33:14.392 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.074+0000 7f0705a00700 1 -- 172.21.15.5:0/3518217703 shutdown_connections 2024-01-24T15:33:14.392 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.074+0000 7f0705a00700 1 --2- 172.21.15.5:0/3518217703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f070007ad60 0x7f070019bca0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:14.392 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.074+0000 7f0705a00700 1 -- 172.21.15.5:0/3518217703 >> 172.21.15.5:0/3518217703 conn(0x7f0700101c00 msgr2=0x7f07001035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:14.392 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.075+0000 7f0705a00700 1 -- 172.21.15.5:0/3518217703 shutdown_connections 2024-01-24T15:33:14.392 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.075+0000 7f0705a00700 1 -- 172.21.15.5:0/3518217703 wait complete. 2024-01-24T15:33:14.392 INFO:teuthology.orchestra.run.smithi005.stdout:mon is available 2024-01-24T15:33:14.393 INFO:teuthology.orchestra.run.smithi005.stdout:Assimilating anything we can from ceph.conf... 2024-01-24T15:33:14.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:14 smithi005 ceph-mon[34855]: mon.a is new leader, mons a in quorum (ranks 0) 2024-01-24T15:33:14.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:14 smithi005 ceph-mon[34855]: monmap e1: 1 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-24T15:33:14.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:14 smithi005 ceph-mon[34855]: fsmap 2024-01-24T15:33:14.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:14 smithi005 ceph-mon[34855]: osdmap e1: 0 total, 0 up, 0 in 2024-01-24T15:33:14.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:14 smithi005 ceph-mon[34855]: mgrmap e1: no daemons active 2024-01-24T15:33:14.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:14 smithi005 ceph-mon[34855]: from='client.? 172.21.15.5:0/3518217703' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-01-24T15:33:15.207 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-01-24T15:33:15.207 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [global] 2024-01-24T15:33:15.207 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout fsid = bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:33:15.207 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.5:3300,v1:172.21.15.5:6789] 2024-01-24T15:33:15.207 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-01-24T15:33:15.207 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-01-24T15:33:15.207 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-01-24T15:33:15.207 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-01-24T15:33:15.207 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-01-24T15:33:15.208 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [mgr] 2024-01-24T15:33:15.208 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-01-24T15:33:15.208 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-01-24T15:33:15.208 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [osd] 2024-01-24T15:33:15.208 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-01-24T15:33:15.208 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-01-24T15:33:15.208 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-01-24T15:33:15.208 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-01-24T15:33:15.208 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-01-24T15:33:15.208 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.784+0000 7f1664e00700 1 Processor -- start 2024-01-24T15:33:15.208 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.785+0000 7f1664e00700 1 -- start start 2024-01-24T15:33:15.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.785+0000 7f1664e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1660104f00 0x7f1660105320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:15.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.785+0000 7f1664e00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16600744a0 con 0x7f1660104f00 2024-01-24T15:33:15.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.786+0000 7f165de00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1660104f00 0x7f1660105320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:15.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.786+0000 7f165de00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1660104f00 0x7f1660105320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52154/0 (socket says 172.21.15.5:52154) 2024-01-24T15:33:15.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.786+0000 7f165de00700 1 -- 172.21.15.5:0/4254795844 learned_addr learned my addr 172.21.15.5:0/4254795844 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:15.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.786+0000 7f165de00700 1 -- 172.21.15.5:0/4254795844 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1660105860 con 0x7f1660104f00 2024-01-24T15:33:15.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.786+0000 7f165de00700 1 --2- 172.21.15.5:0/4254795844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1660104f00 0x7f1660105320 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f16500098a0 tx=0x7f1650009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05127ed7ee7dbcb server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:15.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.786+0000 7f165d400700 1 -- 172.21.15.5:0/4254795844 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1650004160 con 0x7f1660104f00 2024-01-24T15:33:15.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.786+0000 7f165d400700 1 -- 172.21.15.5:0/4254795844 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16500042c0 con 0x7f1660104f00 2024-01-24T15:33:15.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.786+0000 7f165d400700 1 -- 172.21.15.5:0/4254795844 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f16500045a0 con 0x7f1660104f00 2024-01-24T15:33:15.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.787+0000 7f1664e00700 1 -- 172.21.15.5:0/4254795844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1660104f00 msgr2=0x7f1660105320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:15.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.787+0000 7f1664e00700 1 --2- 172.21.15.5:0/4254795844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1660104f00 0x7f1660105320 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f16500098a0 tx=0x7f1650009bb0 comp rx=0 tx=0).stop 2024-01-24T15:33:15.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.787+0000 7f1664e00700 1 -- 172.21.15.5:0/4254795844 shutdown_connections 2024-01-24T15:33:15.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.787+0000 7f1664e00700 1 --2- 172.21.15.5:0/4254795844 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1660104f00 0x7f1660105320 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:15.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.787+0000 7f1664e00700 1 -- 172.21.15.5:0/4254795844 >> 172.21.15.5:0/4254795844 conn(0x7f1660100b20 msgr2=0x7f1660102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:15.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.787+0000 7f1664e00700 1 -- 172.21.15.5:0/4254795844 shutdown_connections 2024-01-24T15:33:15.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.787+0000 7f1664e00700 1 -- 172.21.15.5:0/4254795844 wait complete. 2024-01-24T15:33:15.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.788+0000 7f1664e00700 1 Processor -- start 2024-01-24T15:33:15.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.788+0000 7f1664e00700 1 -- start start 2024-01-24T15:33:15.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.789+0000 7f1664e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1660104f00 0x7f166019bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:15.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.789+0000 7f1664e00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f166019c1f0 con 0x7f1660104f00 2024-01-24T15:33:15.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.789+0000 7f165de00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1660104f00 0x7f166019bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:15.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.789+0000 7f165de00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1660104f00 0x7f166019bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52162/0 (socket says 172.21.15.5:52162) 2024-01-24T15:33:15.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.789+0000 7f165de00700 1 -- 172.21.15.5:0/1196764826 learned_addr learned my addr 172.21.15.5:0/1196764826 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:15.211 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.789+0000 7f165de00700 1 -- 172.21.15.5:0/1196764826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1650009550 con 0x7f1660104f00 2024-01-24T15:33:15.211 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.789+0000 7f165de00700 1 --2- 172.21.15.5:0/1196764826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1660104f00 0x7f166019bcb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f16600738e0 tx=0x7f1650004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:15.211 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.790+0000 7f1656a00700 1 -- 172.21.15.5:0/1196764826 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1650011630 con 0x7f1660104f00 2024-01-24T15:33:15.211 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.790+0000 7f1656a00700 1 -- 172.21.15.5:0/1196764826 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1650011790 con 0x7f1660104f00 2024-01-24T15:33:15.211 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.790+0000 7f1656a00700 1 -- 172.21.15.5:0/1196764826 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1650011a30 con 0x7f1660104f00 2024-01-24T15:33:15.211 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.790+0000 7f1664e00700 1 -- 172.21.15.5:0/1196764826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f166019c3f0 con 0x7f1660104f00 2024-01-24T15:33:15.211 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.790+0000 7f1664e00700 1 -- 172.21.15.5:0/1196764826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f166019c810 con 0x7f1660104f00 2024-01-24T15:33:15.211 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.790+0000 7f1656a00700 1 -- 172.21.15.5:0/1196764826 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1650022070 con 0x7f1660104f00 2024-01-24T15:33:15.211 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.790+0000 7f1656a00700 1 -- 172.21.15.5:0/1196764826 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f165001c450 con 0x7f1660104f00 2024-01-24T15:33:15.211 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.791+0000 7f1664e00700 1 -- 172.21.15.5:0/1196764826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1660195990 con 0x7f1660104f00 2024-01-24T15:33:15.211 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.793+0000 7f1656a00700 1 -- 172.21.15.5:0/1196764826 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f165001b450 con 0x7f1660104f00 2024-01-24T15:33:15.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.867+0000 7f1664e00700 1 -- 172.21.15.5:0/1196764826 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f1660062370 con 0x7f1660104f00 2024-01-24T15:33:15.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.871+0000 7f1656a00700 1 -- 172.21.15.5:0/1196764826 <== mon.0 v2:172.21.15.5:3300/0 7 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f165001b5f0 con 0x7f1660104f00 2024-01-24T15:33:15.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.872+0000 7f1656a00700 1 -- 172.21.15.5:0/1196764826 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+427 (secure 0 0 0) 0x7f1650037540 con 0x7f1660104f00 2024-01-24T15:33:15.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.873+0000 7f1664e00700 1 -- 172.21.15.5:0/1196764826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1660104f00 msgr2=0x7f166019bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:15.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.873+0000 7f1664e00700 1 --2- 172.21.15.5:0/1196764826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1660104f00 0x7f166019bcb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f16600738e0 tx=0x7f1650004750 comp rx=0 tx=0).stop 2024-01-24T15:33:15.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.873+0000 7f1664e00700 1 -- 172.21.15.5:0/1196764826 shutdown_connections 2024-01-24T15:33:15.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.873+0000 7f1664e00700 1 --2- 172.21.15.5:0/1196764826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1660104f00 0x7f166019bcb0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:15.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.873+0000 7f1664e00700 1 -- 172.21.15.5:0/1196764826 >> 172.21.15.5:0/1196764826 conn(0x7f1660100b20 msgr2=0x7f1660192ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:15.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.873+0000 7f1664e00700 1 -- 172.21.15.5:0/1196764826 shutdown_connections 2024-01-24T15:33:15.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:14.873+0000 7f1664e00700 1 -- 172.21.15.5:0/1196764826 wait complete. 2024-01-24T15:33:15.212 INFO:teuthology.orchestra.run.smithi005.stdout:Generating new minimal ceph.conf... 2024-01-24T15:33:15.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:15 smithi005 ceph-mon[34855]: from='client.? 172.21.15.5:0/1196764826' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-01-24T15:33:15.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:15 smithi005 ceph-mon[34855]: from='client.? 172.21.15.5:0/1196764826' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-01-24T15:33:16.004 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.586+0000 7fa07fa00700 1 Processor -- start 2024-01-24T15:33:16.004 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.586+0000 7fa07fa00700 1 -- start start 2024-01-24T15:33:16.004 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.586+0000 7fa07fa00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa078106620 0x7fa078106a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:16.004 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.586+0000 7fa07fa00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa078107010 con 0x7fa078106620 2024-01-24T15:33:16.004 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.587+0000 7fa07d000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa078106620 0x7fa078106a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:16.004 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.587+0000 7fa07d000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa078106620 0x7fa078106a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52178/0 (socket says 172.21.15.5:52178) 2024-01-24T15:33:16.004 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.587+0000 7fa07d000700 1 -- 172.21.15.5:0/2742693451 learned_addr learned my addr 172.21.15.5:0/2742693451 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:16.004 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.587+0000 7fa07d000700 1 -- 172.21.15.5:0/2742693451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa078107820 con 0x7fa078106620 2024-01-24T15:33:16.005 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.587+0000 7fa07d000700 1 --2- 172.21.15.5:0/2742693451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa078106620 0x7fa078106a40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa0680098a0 tx=0x7fa068009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3635cac732878af server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:16.005 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.587+0000 7fa077400700 1 -- 172.21.15.5:0/2742693451 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa068004160 con 0x7fa078106620 2024-01-24T15:33:16.005 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.588+0000 7fa077400700 1 -- 172.21.15.5:0/2742693451 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fa0680042c0 con 0x7fa078106620 2024-01-24T15:33:16.005 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.588+0000 7fa077400700 1 -- 172.21.15.5:0/2742693451 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa068011940 con 0x7fa078106620 2024-01-24T15:33:16.005 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.588+0000 7fa07fa00700 1 -- 172.21.15.5:0/2742693451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa078106620 msgr2=0x7fa078106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:16.005 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.588+0000 7fa07fa00700 1 --2- 172.21.15.5:0/2742693451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa078106620 0x7fa078106a40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa0680098a0 tx=0x7fa068009bb0 comp rx=0 tx=0).stop 2024-01-24T15:33:16.005 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.588+0000 7fa07fa00700 1 -- 172.21.15.5:0/2742693451 shutdown_connections 2024-01-24T15:33:16.005 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.588+0000 7fa07fa00700 1 --2- 172.21.15.5:0/2742693451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa078106620 0x7fa078106a40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:16.005 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.588+0000 7fa07fa00700 1 -- 172.21.15.5:0/2742693451 >> 172.21.15.5:0/2742693451 conn(0x7fa078101c00 msgr2=0x7fa078104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:16.005 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.588+0000 7fa07fa00700 1 -- 172.21.15.5:0/2742693451 shutdown_connections 2024-01-24T15:33:16.005 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.588+0000 7fa07fa00700 1 -- 172.21.15.5:0/2742693451 wait complete. 2024-01-24T15:33:16.005 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.589+0000 7fa07fa00700 1 Processor -- start 2024-01-24T15:33:16.005 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.590+0000 7fa07fa00700 1 -- start start 2024-01-24T15:33:16.006 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.590+0000 7fa07fa00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa078106620 0x7fa07819c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:16.006 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.590+0000 7fa07fa00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07819c930 con 0x7fa078106620 2024-01-24T15:33:16.006 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.590+0000 7fa07d000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa078106620 0x7fa07819c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:16.006 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.590+0000 7fa07d000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa078106620 0x7fa07819c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52186/0 (socket says 172.21.15.5:52186) 2024-01-24T15:33:16.006 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.590+0000 7fa07d000700 1 -- 172.21.15.5:0/2987112704 learned_addr learned my addr 172.21.15.5:0/2987112704 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:16.006 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.590+0000 7fa07d000700 1 -- 172.21.15.5:0/2987112704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa068009550 con 0x7fa078106620 2024-01-24T15:33:16.006 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.591+0000 7fa07d000700 1 --2- 172.21.15.5:0/2987112704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa078106620 0x7fa07819c3f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa068000c00 tx=0x7fa068011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:16.006 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.591+0000 7fa075600700 1 -- 172.21.15.5:0/2987112704 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0680036a0 con 0x7fa078106620 2024-01-24T15:33:16.006 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.591+0000 7fa075600700 1 -- 172.21.15.5:0/2987112704 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fa06801b440 con 0x7fa078106620 2024-01-24T15:33:16.006 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.591+0000 7fa075600700 1 -- 172.21.15.5:0/2987112704 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0680193f0 con 0x7fa078106620 2024-01-24T15:33:16.006 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.591+0000 7fa07fa00700 1 -- 172.21.15.5:0/2987112704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07819cb30 con 0x7fa078106620 2024-01-24T15:33:16.006 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.591+0000 7fa07fa00700 1 -- 172.21.15.5:0/2987112704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07819cf50 con 0x7fa078106620 2024-01-24T15:33:16.006 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.591+0000 7fa075600700 1 -- 172.21.15.5:0/2987112704 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa0680198e0 con 0x7fa078106620 2024-01-24T15:33:16.007 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.592+0000 7fa075600700 1 -- 172.21.15.5:0/2987112704 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa06801a3d0 con 0x7fa078106620 2024-01-24T15:33:16.007 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.592+0000 7fa07fa00700 1 -- 172.21.15.5:0/2987112704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa078062370 con 0x7fa078106620 2024-01-24T15:33:16.007 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.595+0000 7fa075600700 1 -- 172.21.15.5:0/2987112704 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7fa068029060 con 0x7fa078106620 2024-01-24T15:33:16.007 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.668+0000 7fa07fa00700 1 -- 172.21.15.5:0/2987112704 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fa07810aa50 con 0x7fa078106620 2024-01-24T15:33:16.007 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.669+0000 7fa075600700 1 -- 172.21.15.5:0/2987112704 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+173 (secure 0 0 0) 0x7fa06801f070 con 0x7fa078106620 2024-01-24T15:33:16.007 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.669+0000 7fa07fa00700 1 -- 172.21.15.5:0/2987112704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa078106620 msgr2=0x7fa07819c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:16.007 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.670+0000 7fa07fa00700 1 --2- 172.21.15.5:0/2987112704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa078106620 0x7fa07819c3f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa068000c00 tx=0x7fa068011e70 comp rx=0 tx=0).stop 2024-01-24T15:33:16.007 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.670+0000 7fa07fa00700 1 -- 172.21.15.5:0/2987112704 shutdown_connections 2024-01-24T15:33:16.007 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.670+0000 7fa07fa00700 1 --2- 172.21.15.5:0/2987112704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa078106620 0x7fa07819c3f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:16.007 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.670+0000 7fa07fa00700 1 -- 172.21.15.5:0/2987112704 >> 172.21.15.5:0/2987112704 conn(0x7fa078101c00 msgr2=0x7fa078102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:16.007 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.670+0000 7fa07fa00700 1 -- 172.21.15.5:0/2987112704 shutdown_connections 2024-01-24T15:33:16.007 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:15.670+0000 7fa07fa00700 1 -- 172.21.15.5:0/2987112704 wait complete. 2024-01-24T15:33:16.007 INFO:teuthology.orchestra.run.smithi005.stdout:Restarting the monitor... 2024-01-24T15:33:16.182 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:16 smithi005 systemd[1]: Stopping Ceph mon.a for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:33:16.623 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:16 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mon-a[34832]: 2024-01-24T15:33:16.305+0000 7f33cec00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:33:16.624 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:16 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mon-a[34832]: 2024-01-24T15:33:16.305+0000 7f33cec00700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-01-24T15:33:16.624 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:16 smithi005 bash[35189]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mon-a 2024-01-24T15:33:17.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:16 smithi005 systemd[1]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mon.a.service: Succeeded. 2024-01-24T15:33:17.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:16 smithi005 systemd[1]: Stopped Ceph mon.a for bede0bb6-bacd-11ee-95b1-87774f69a715. 2024-01-24T15:33:17.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:16 smithi005 systemd[1]: Starting Ceph mon.a for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:33:17.348 INFO:teuthology.orchestra.run.smithi005.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-01-24T15:33:17.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 bash[35308]: 8853ccb4a9ee2d8c232fded20059b61ff0a592c0f4d48223d98aab9f34537f8f 2024-01-24T15:33:17.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 systemd[1]: Started Ceph mon.a for bede0bb6-bacd-11ee-95b1-87774f69a715. 2024-01-24T15:33:17.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: set uid:gid to 167:167 (ceph:ceph) 2024-01-24T15:33:17.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: ceph version 18.2.1-341-g4e3182a6 (4e3182a65800aed6d4aa2f6b86da3cfd72188134) reef (stable), process ceph-mon, pid 7 2024-01-24T15:33:17.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: pidfile_write: ignore empty --pid-file 2024-01-24T15:33:17.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: load: jerasure load: lrc 2024-01-24T15:33:17.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: RocksDB version: 7.9.2 2024-01-24T15:33:17.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Git sha 0 2024-01-24T15:33:17.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Compile date 2024-01-24 06:39:28 2024-01-24T15:33:17.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: DB SUMMARY 2024-01-24T15:33:17.685 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: DB Session ID: 5E3FUY3KEAAVNYAJJQF8 2024-01-24T15:33:17.685 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: CURRENT file: CURRENT 2024-01-24T15:33:17.685 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: IDENTITY file: IDENTITY 2024-01-24T15:33:17.685 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-01-24T15:33:17.685 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-01-24T15:33:17.685 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 98827 ; 2024-01-24T15:33:17.685 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.error_if_exists: 0 2024-01-24T15:33:17.685 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.create_if_missing: 0 2024-01-24T15:33:17.685 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.paranoid_checks: 1 2024-01-24T15:33:17.685 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.flush_verify_memtable_count: 1 2024-01-24T15:33:17.685 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-01-24T15:33:17.686 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-01-24T15:33:17.686 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.env: 0x555fd72d2720 2024-01-24T15:33:17.686 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.fs: PosixFileSystem 2024-01-24T15:33:17.686 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.info_log: 0x555fd8959460 2024-01-24T15:33:17.686 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_file_opening_threads: 16 2024-01-24T15:33:17.686 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.statistics: (nil) 2024-01-24T15:33:17.686 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.use_fsync: 0 2024-01-24T15:33:17.686 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_log_file_size: 0 2024-01-24T15:33:17.686 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-01-24T15:33:17.686 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.log_file_time_to_roll: 0 2024-01-24T15:33:17.687 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.keep_log_file_num: 1000 2024-01-24T15:33:17.687 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.recycle_log_file_num: 0 2024-01-24T15:33:17.687 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.allow_fallocate: 1 2024-01-24T15:33:17.687 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.allow_mmap_reads: 0 2024-01-24T15:33:17.687 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.allow_mmap_writes: 0 2024-01-24T15:33:17.687 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.use_direct_reads: 0 2024-01-24T15:33:17.687 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-01-24T15:33:17.687 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.create_missing_column_families: 0 2024-01-24T15:33:17.687 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.db_log_dir: 2024-01-24T15:33:17.687 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.wal_dir: 2024-01-24T15:33:17.687 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.table_cache_numshardbits: 6 2024-01-24T15:33:17.688 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.WAL_ttl_seconds: 0 2024-01-24T15:33:17.688 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.WAL_size_limit_MB: 0 2024-01-24T15:33:17.688 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-01-24T15:33:17.688 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-01-24T15:33:17.688 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.is_fd_close_on_exec: 1 2024-01-24T15:33:17.688 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.advise_random_on_open: 1 2024-01-24T15:33:17.688 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.db_write_buffer_size: 0 2024-01-24T15:33:17.688 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.write_buffer_manager: 0x555fd7bea320 2024-01-24T15:33:17.688 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-01-24T15:33:17.688 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-01-24T15:33:17.688 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.use_adaptive_mutex: 0 2024-01-24T15:33:17.689 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.rate_limiter: (nil) 2024-01-24T15:33:17.689 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-01-24T15:33:17.689 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.wal_recovery_mode: 2 2024-01-24T15:33:17.689 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.enable_thread_tracking: 0 2024-01-24T15:33:17.689 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.enable_pipelined_write: 0 2024-01-24T15:33:17.689 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.unordered_write: 0 2024-01-24T15:33:17.689 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-01-24T15:33:17.689 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-01-24T15:33:17.689 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-01-24T15:33:17.689 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-01-24T15:33:17.689 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.row_cache: None 2024-01-24T15:33:17.689 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.wal_filter: None 2024-01-24T15:33:17.689 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-01-24T15:33:17.690 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.allow_ingest_behind: 0 2024-01-24T15:33:17.690 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.two_write_queues: 0 2024-01-24T15:33:17.690 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.manual_wal_flush: 0 2024-01-24T15:33:17.690 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.wal_compression: 0 2024-01-24T15:33:17.690 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.atomic_flush: 0 2024-01-24T15:33:17.690 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-01-24T15:33:17.690 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.persist_stats_to_disk: 0 2024-01-24T15:33:17.690 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.write_dbid_to_manifest: 0 2024-01-24T15:33:17.690 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.log_readahead_size: 0 2024-01-24T15:33:17.690 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-01-24T15:33:17.690 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.best_efforts_recovery: 0 2024-01-24T15:33:17.690 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-01-24T15:33:17.690 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-01-24T15:33:17.691 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.allow_data_in_errors: 0 2024-01-24T15:33:17.692 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.db_host_id: __hostname__ 2024-01-24T15:33:17.692 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.enforce_single_del_contracts: true 2024-01-24T15:33:17.692 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_background_jobs: 2 2024-01-24T15:33:17.692 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_background_compactions: -1 2024-01-24T15:33:17.692 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_subcompactions: 1 2024-01-24T15:33:17.692 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-01-24T15:33:17.692 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-01-24T15:33:17.693 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.delayed_write_rate : 16777216 2024-01-24T15:33:17.693 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_total_wal_size: 0 2024-01-24T15:33:17.693 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-01-24T15:33:17.693 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.stats_dump_period_sec: 600 2024-01-24T15:33:17.693 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.stats_persist_period_sec: 600 2024-01-24T15:33:17.693 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-01-24T15:33:17.693 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_open_files: -1 2024-01-24T15:33:17.693 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.bytes_per_sync: 0 2024-01-24T15:33:17.693 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.wal_bytes_per_sync: 0 2024-01-24T15:33:17.693 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.strict_bytes_per_sync: 0 2024-01-24T15:33:17.693 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.compaction_readahead_size: 0 2024-01-24T15:33:17.693 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_background_flushes: -1 2024-01-24T15:33:17.693 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Compression algorithms supported: 2024-01-24T15:33:17.694 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-01-24T15:33:17.694 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: kZSTD supported: 0 2024-01-24T15:33:17.694 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: kXpressCompression supported: 0 2024-01-24T15:33:17.694 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: kLZ4HCCompression supported: 1 2024-01-24T15:33:17.694 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: kZlibCompression supported: 1 2024-01-24T15:33:17.694 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: kSnappyCompression supported: 1 2024-01-24T15:33:17.694 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: kLZ4Compression supported: 1 2024-01-24T15:33:17.694 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: kBZip2Compression supported: 0 2024-01-24T15:33:17.694 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Fast CRC32 supported: Supported on x86 2024-01-24T15:33:17.694 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: DMutex implementation: pthread_mutex_t 2024-01-24T15:33:17.694 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-01-24T15:33:17.694 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-01-24T15:33:17.695 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-01-24T15:33:17.695 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.merge_operator: 2024-01-24T15:33:17.695 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.compaction_filter: None 2024-01-24T15:33:17.695 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.compaction_filter_factory: None 2024-01-24T15:33:17.695 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.sst_partitioner_factory: None 2024-01-24T15:33:17.695 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.memtable_factory: SkipListFactory 2024-01-24T15:33:17.695 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.table_factory: BlockBasedTable 2024-01-24T15:33:17.695 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555fd8959560) 2024-01-24T15:33:17.695 INFO:journalctl@ceph.mon.a.smithi005.stdout: cache_index_and_filter_blocks: 1 2024-01-24T15:33:17.695 INFO:journalctl@ceph.mon.a.smithi005.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-01-24T15:33:17.695 INFO:journalctl@ceph.mon.a.smithi005.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-01-24T15:33:17.695 INFO:journalctl@ceph.mon.a.smithi005.stdout: pin_top_level_index_and_filter: 1 2024-01-24T15:33:17.696 INFO:journalctl@ceph.mon.a.smithi005.stdout: index_type: 0 2024-01-24T15:33:17.696 INFO:journalctl@ceph.mon.a.smithi005.stdout: data_block_index_type: 0 2024-01-24T15:33:17.696 INFO:journalctl@ceph.mon.a.smithi005.stdout: index_shortening: 1 2024-01-24T15:33:17.696 INFO:journalctl@ceph.mon.a.smithi005.stdout: data_block_hash_table_util_ratio: 0.750000 2024-01-24T15:33:17.696 INFO:journalctl@ceph.mon.a.smithi005.stdout: checksum: 4 2024-01-24T15:33:17.696 INFO:journalctl@ceph.mon.a.smithi005.stdout: no_block_cache: 0 2024-01-24T15:33:17.696 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_cache: 0x555fd7c6b1f0 2024-01-24T15:33:17.696 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_cache_name: BinnedLRUCache 2024-01-24T15:33:17.696 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_cache_options: 2024-01-24T15:33:17.696 INFO:journalctl@ceph.mon.a.smithi005.stdout: capacity : 536870912 2024-01-24T15:33:17.696 INFO:journalctl@ceph.mon.a.smithi005.stdout: num_shard_bits : 4 2024-01-24T15:33:17.697 INFO:journalctl@ceph.mon.a.smithi005.stdout: strict_capacity_limit : 0 2024-01-24T15:33:17.697 INFO:journalctl@ceph.mon.a.smithi005.stdout: high_pri_pool_ratio: 0.000 2024-01-24T15:33:17.697 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_cache_compressed: (nil) 2024-01-24T15:33:17.697 INFO:journalctl@ceph.mon.a.smithi005.stdout: persistent_cache: (nil) 2024-01-24T15:33:17.697 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_size: 4096 2024-01-24T15:33:17.697 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_size_deviation: 10 2024-01-24T15:33:17.697 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_restart_interval: 16 2024-01-24T15:33:17.697 INFO:journalctl@ceph.mon.a.smithi005.stdout: index_block_restart_interval: 1 2024-01-24T15:33:17.697 INFO:journalctl@ceph.mon.a.smithi005.stdout: metadata_block_size: 4096 2024-01-24T15:33:17.697 INFO:journalctl@ceph.mon.a.smithi005.stdout: partition_filters: 0 2024-01-24T15:33:17.697 INFO:journalctl@ceph.mon.a.smithi005.stdout: use_delta_encoding: 1 2024-01-24T15:33:17.698 INFO:journalctl@ceph.mon.a.smithi005.stdout: filter_policy: bloomfilter 2024-01-24T15:33:17.698 INFO:journalctl@ceph.mon.a.smithi005.stdout: whole_key_filtering: 1 2024-01-24T15:33:17.698 INFO:journalctl@ceph.mon.a.smithi005.stdout: verify_compression: 0 2024-01-24T15:33:17.698 INFO:journalctl@ceph.mon.a.smithi005.stdout: read_amp_bytes_per_bit: 0 2024-01-24T15:33:17.698 INFO:journalctl@ceph.mon.a.smithi005.stdout: format_version: 5 2024-01-24T15:33:17.698 INFO:journalctl@ceph.mon.a.smithi005.stdout: enable_index_compression: 1 2024-01-24T15:33:17.698 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_align: 0 2024-01-24T15:33:17.698 INFO:journalctl@ceph.mon.a.smithi005.stdout: max_auto_readahead_size: 262144 2024-01-24T15:33:17.698 INFO:journalctl@ceph.mon.a.smithi005.stdout: prepopulate_block_cache: 0 2024-01-24T15:33:17.698 INFO:journalctl@ceph.mon.a.smithi005.stdout: initial_auto_readahead_size: 8192 2024-01-24T15:33:17.698 INFO:journalctl@ceph.mon.a.smithi005.stdout: num_file_reads_for_auto_readahead: 2 2024-01-24T15:33:17.698 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.write_buffer_size: 33554432 2024-01-24T15:33:17.698 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_write_buffer_number: 2 2024-01-24T15:33:17.699 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.compression: NoCompression 2024-01-24T15:33:17.699 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.bottommost_compression: Disabled 2024-01-24T15:33:17.699 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.prefix_extractor: nullptr 2024-01-24T15:33:17.699 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-01-24T15:33:17.699 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.num_levels: 7 2024-01-24T15:33:17.699 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-01-24T15:33:17.699 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-01-24T15:33:17.699 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-01-24T15:33:17.699 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-01-24T15:33:17.699 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-01-24T15:33:17.699 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-01-24T15:33:17.699 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-01-24T15:33:17.700 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-01-24T15:33:17.700 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-01-24T15:33:17.700 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-01-24T15:33:17.700 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-01-24T15:33:17.700 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-01-24T15:33:17.700 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.compression_opts.window_bits: -14 2024-01-24T15:33:17.700 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.compression_opts.level: 32767 2024-01-24T15:33:17.700 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.compression_opts.strategy: 0 2024-01-24T15:33:17.700 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-01-24T15:33:17.700 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-01-24T15:33:17.700 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-01-24T15:33:17.700 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-01-24T15:33:17.701 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.compression_opts.enabled: false 2024-01-24T15:33:17.701 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-01-24T15:33:17.701 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-01-24T15:33:17.701 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-01-24T15:33:17.701 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-01-24T15:33:17.701 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.target_file_size_base: 67108864 2024-01-24T15:33:17.701 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.target_file_size_multiplier: 1 2024-01-24T15:33:17.701 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-01-24T15:33:17.701 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-01-24T15:33:17.701 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-01-24T15:33:17.701 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-01-24T15:33:17.701 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-01-24T15:33:17.701 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-01-24T15:33:17.702 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-01-24T15:33:17.702 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-01-24T15:33:17.702 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-01-24T15:33:17.702 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-01-24T15:33:17.702 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-01-24T15:33:17.702 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-01-24T15:33:17.702 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-01-24T15:33:17.702 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.arena_block_size: 1048576 2024-01-24T15:33:17.702 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-01-24T15:33:17.702 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-01-24T15:33:17.702 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.disable_auto_compactions: 0 2024-01-24T15:33:17.702 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-01-24T15:33:17.702 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-01-24T15:33:17.702 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-01-24T15:33:17.703 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-01-24T15:33:17.703 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-01-24T15:33:17.703 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-01-24T15:33:17.703 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-01-24T15:33:17.703 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-01-24T15:33:17.703 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-01-24T15:33:17.703 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-01-24T15:33:17.703 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.table_properties_collectors: 2024-01-24T15:33:17.703 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.inplace_update_support: 0 2024-01-24T15:33:17.703 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.inplace_update_num_locks: 10000 2024-01-24T15:33:17.703 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-01-24T15:33:17.703 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-01-24T15:33:17.703 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.memtable_huge_page_size: 0 2024-01-24T15:33:17.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.bloom_locality: 0 2024-01-24T15:33:17.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.max_successive_merges: 0 2024-01-24T15:33:17.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.optimize_filters_for_hits: 0 2024-01-24T15:33:17.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.paranoid_file_checks: 0 2024-01-24T15:33:17.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.force_consistency_checks: 1 2024-01-24T15:33:17.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.report_bg_io_stats: 0 2024-01-24T15:33:17.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.ttl: 2592000 2024-01-24T15:33:17.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.periodic_compaction_seconds: 0 2024-01-24T15:33:17.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-01-24T15:33:17.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-01-24T15:33:17.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.enable_blob_files: false 2024-01-24T15:33:17.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.min_blob_size: 0 2024-01-24T15:33:17.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.blob_file_size: 268435456 2024-01-24T15:33:17.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.blob_compression_type: NoCompression 2024-01-24T15:33:17.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.enable_blob_garbage_collection: false 2024-01-24T15:33:17.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-01-24T15:33:17.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-01-24T15:33:17.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-01-24T15:33:17.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.blob_file_starting_level: 0 2024-01-24T15:33:17.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-01-24T15:33:17.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-01-24T15:33:17.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-01-24T15:33:17.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 34620330-5f1b-4c06-a52d-cb42954f7d50 2024-01-24T15:33:17.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: EVENT_LOG_v1 {"time_micros": 1706110397365147, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-01-24T15:33:17.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-01-24T15:33:17.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: EVENT_LOG_v1 {"time_micros": 1706110397367045, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94112, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 313, "table_properties": {"data_size": 92101, "index_size": 293, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13941, "raw_average_key_size": 50, "raw_value_size": 84507, "raw_average_value_size": 306, "num_data_blocks": 11, "num_entries": 276, "num_filter_entries": 276, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1706110397, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "34620330-5f1b-4c06-a52d-cb42954f7d50", "db_session_id": "5E3FUY3KEAAVNYAJJQF8", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-01-24T15:33:17.706 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: EVENT_LOG_v1 {"time_micros": 1706110397367186, "job": 1, "event": "recovery_finished"} 2024-01-24T15:33:17.706 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-01-24T15:33:17.706 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-01-24T15:33:17.706 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x555fd7d08000 2024-01-24T15:33:17.706 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: DB pointer 0x555fd7cf6000 2024-01-24T15:33:17.706 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-01-24T15:33:17.706 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-01-24T15:33:17.706 INFO:journalctl@ceph.mon.a.smithi005.stdout: ** DB Stats ** 2024-01-24T15:33:17.706 INFO:journalctl@ceph.mon.a.smithi005.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-24T15:33:17.706 INFO:journalctl@ceph.mon.a.smithi005.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-01-24T15:33:17.706 INFO:journalctl@ceph.mon.a.smithi005.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-24T15:33:17.706 INFO:journalctl@ceph.mon.a.smithi005.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-24T15:33:17.706 INFO:journalctl@ceph.mon.a.smithi005.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-01-24T15:33:17.707 INFO:journalctl@ceph.mon.a.smithi005.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-24T15:33:17.707 INFO:journalctl@ceph.mon.a.smithi005.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-24T15:33:17.707 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2024-01-24T15:33:17.707 INFO:journalctl@ceph.mon.a.smithi005.stdout: ** Compaction Stats [default] ** 2024-01-24T15:33:17.707 INFO:journalctl@ceph.mon.a.smithi005.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-01-24T15:33:17.707 INFO:journalctl@ceph.mon.a.smithi005.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-01-24T15:33:17.707 INFO:journalctl@ceph.mon.a.smithi005.stdout: L0 2/0 93.74 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 73.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-01-24T15:33:17.707 INFO:journalctl@ceph.mon.a.smithi005.stdout: Sum 2/0 93.74 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 73.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-01-24T15:33:17.707 INFO:journalctl@ceph.mon.a.smithi005.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 73.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-01-24T15:33:17.707 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2024-01-24T15:33:17.707 INFO:journalctl@ceph.mon.a.smithi005.stdout: ** Compaction Stats [default] ** 2024-01-24T15:33:17.707 INFO:journalctl@ceph.mon.a.smithi005.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-01-24T15:33:17.707 INFO:journalctl@ceph.mon.a.smithi005.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-24T15:33:17.707 INFO:journalctl@ceph.mon.a.smithi005.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 73.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-01-24T15:33:17.708 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2024-01-24T15:33:17.708 INFO:journalctl@ceph.mon.a.smithi005.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-01-24T15:33:17.708 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2024-01-24T15:33:17.708 INFO:journalctl@ceph.mon.a.smithi005.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-24T15:33:17.708 INFO:journalctl@ceph.mon.a.smithi005.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-01-24T15:33:17.708 INFO:journalctl@ceph.mon.a.smithi005.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-24T15:33:17.708 INFO:journalctl@ceph.mon.a.smithi005.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-01-24T15:33:17.708 INFO:journalctl@ceph.mon.a.smithi005.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-01-24T15:33:17.708 INFO:journalctl@ceph.mon.a.smithi005.stdout: AddFile(Keys): cumulative 0, interval 0 2024-01-24T15:33:17.708 INFO:journalctl@ceph.mon.a.smithi005.stdout: Cumulative compaction: 0.00 GB write, 11.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-24T15:33:17.708 INFO:journalctl@ceph.mon.a.smithi005.stdout: Interval compaction: 0.00 GB write, 11.81 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-24T15:33:17.708 INFO:journalctl@ceph.mon.a.smithi005.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-24T15:33:17.709 INFO:journalctl@ceph.mon.a.smithi005.stdout: Block cache BinnedLRUCache@0x555fd7c6b1f0#7 capacity: 512.00 MB usage: 1.39 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-01-24T15:33:17.709 INFO:journalctl@ceph.mon.a.smithi005.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-01-24T15:33:17.709 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2024-01-24T15:33:17.709 INFO:journalctl@ceph.mon.a.smithi005.stdout: ** File Read Latency Histogram By Level [default] ** 2024-01-24T15:33:17.709 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: starting mon.a rank 0 at public addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] at bind addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:33:17.709 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: mon.a@-1(???) e1 preinit fsid bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:33:17.709 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: mon.a@-1(???).mds e1 new map 2024-01-24T15:33:17.709 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: mon.a@-1(???).mds e1 print_map 2024-01-24T15:33:17.709 INFO:journalctl@ceph.mon.a.smithi005.stdout: e1 2024-01-24T15:33:17.709 INFO:journalctl@ceph.mon.a.smithi005.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-01-24T15:33:17.709 INFO:journalctl@ceph.mon.a.smithi005.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-01-24T15:33:17.710 INFO:journalctl@ceph.mon.a.smithi005.stdout: legacy client fscid: -1 2024-01-24T15:33:17.710 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2024-01-24T15:33:17.710 INFO:journalctl@ceph.mon.a.smithi005.stdout: No filesystems configured 2024-01-24T15:33:17.710 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-01-24T15:33:17.710 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-01-24T15:33:17.710 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-01-24T15:33:17.710 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-01-24T15:33:17.710 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-01-24T15:33:17.710 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: mon.a is new leader, mons a in quorum (ranks 0) 2024-01-24T15:33:17.710 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: monmap e1: 1 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-24T15:33:17.710 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: fsmap 2024-01-24T15:33:17.710 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: osdmap e1: 0 total, 0 up, 0 in 2024-01-24T15:33:17.711 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:17 smithi005 ceph-mon[35346]: mgrmap e1: no daemons active 2024-01-24T15:33:18.192 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.776+0000 7f2425400700 1 Processor -- start 2024-01-24T15:33:18.192 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.776+0000 7f2425400700 1 -- start start 2024-01-24T15:33:18.192 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.776+0000 7f2425400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2420106620 0x7f2420106a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:18.197 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.776+0000 7f2425400700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2420107010 con 0x7f2420106620 2024-01-24T15:33:18.197 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.777+0000 7f241e800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2420106620 0x7f2420106a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:18.197 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.777+0000 7f241e800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2420106620 0x7f2420106a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52194/0 (socket says 172.21.15.5:52194) 2024-01-24T15:33:18.197 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.777+0000 7f241e800700 1 -- 172.21.15.5:0/4139260355 learned_addr learned my addr 172.21.15.5:0/4139260355 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:18.197 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.777+0000 7f241e800700 1 -- 172.21.15.5:0/4139260355 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2420107820 con 0x7f2420106620 2024-01-24T15:33:18.197 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.778+0000 7f241e800700 1 --2- 172.21.15.5:0/4139260355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2420106620 0x7f2420106a40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f24100098a0 tx=0x7f2410009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5671aba9a7b4fc69 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:18.197 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.778+0000 7f241d400700 1 -- 172.21.15.5:0/4139260355 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2410004160 con 0x7f2420106620 2024-01-24T15:33:18.197 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.778+0000 7f241d400700 1 -- 172.21.15.5:0/4139260355 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f24100042c0 con 0x7f2420106620 2024-01-24T15:33:18.197 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.778+0000 7f241d400700 1 -- 172.21.15.5:0/4139260355 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2410011940 con 0x7f2420106620 2024-01-24T15:33:18.198 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.778+0000 7f2425400700 1 -- 172.21.15.5:0/4139260355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2420106620 msgr2=0x7f2420106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:18.198 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.778+0000 7f2425400700 1 --2- 172.21.15.5:0/4139260355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2420106620 0x7f2420106a40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f24100098a0 tx=0x7f2410009bb0 comp rx=0 tx=0).stop 2024-01-24T15:33:18.198 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.779+0000 7f2425400700 1 -- 172.21.15.5:0/4139260355 shutdown_connections 2024-01-24T15:33:18.198 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.779+0000 7f2425400700 1 --2- 172.21.15.5:0/4139260355 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2420106620 0x7f2420106a40 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:18.198 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.779+0000 7f2425400700 1 -- 172.21.15.5:0/4139260355 >> 172.21.15.5:0/4139260355 conn(0x7f2420101c00 msgr2=0x7f2420104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:18.198 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.779+0000 7f2425400700 1 -- 172.21.15.5:0/4139260355 shutdown_connections 2024-01-24T15:33:18.198 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.779+0000 7f2425400700 1 -- 172.21.15.5:0/4139260355 wait complete. 2024-01-24T15:33:18.198 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.780+0000 7f2425400700 1 Processor -- start 2024-01-24T15:33:18.198 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.780+0000 7f2425400700 1 -- start start 2024-01-24T15:33:18.198 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.780+0000 7f2425400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2420106620 0x7f242019c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:18.198 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.780+0000 7f2425400700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242019c930 con 0x7f2420106620 2024-01-24T15:33:18.198 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.781+0000 7f241e800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2420106620 0x7f242019c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:18.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.781+0000 7f241e800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2420106620 0x7f242019c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52202/0 (socket says 172.21.15.5:52202) 2024-01-24T15:33:18.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.781+0000 7f241e800700 1 -- 172.21.15.5:0/3575051617 learned_addr learned my addr 172.21.15.5:0/3575051617 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:18.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.781+0000 7f241e800700 1 -- 172.21.15.5:0/3575051617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2410009550 con 0x7f2420106620 2024-01-24T15:33:18.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.781+0000 7f241e800700 1 --2- 172.21.15.5:0/3575051617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2420106620 0x7f242019c3f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2410000c00 tx=0x7f2410011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:18.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.781+0000 7f2417400700 1 -- 172.21.15.5:0/3575051617 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24100036a0 con 0x7f2420106620 2024-01-24T15:33:18.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.782+0000 7f2417400700 1 -- 172.21.15.5:0/3575051617 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f241001b440 con 0x7f2420106620 2024-01-24T15:33:18.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.782+0000 7f2425400700 1 -- 172.21.15.5:0/3575051617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f242019cb30 con 0x7f2420106620 2024-01-24T15:33:18.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.782+0000 7f2417400700 1 -- 172.21.15.5:0/3575051617 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24100193f0 con 0x7f2420106620 2024-01-24T15:33:18.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.782+0000 7f2425400700 1 -- 172.21.15.5:0/3575051617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f242019cf50 con 0x7f2420106620 2024-01-24T15:33:18.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.782+0000 7f2417400700 1 -- 172.21.15.5:0/3575051617 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2410019930 con 0x7f2420106620 2024-01-24T15:33:18.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.782+0000 7f2417400700 1 -- 172.21.15.5:0/3575051617 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f241001a3d0 con 0x7f2420106620 2024-01-24T15:33:18.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.783+0000 7f2425400700 1 -- 172.21.15.5:0/3575051617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2420062370 con 0x7f2420106620 2024-01-24T15:33:18.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.786+0000 7f2417400700 1 -- 172.21.15.5:0/3575051617 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f2410029060 con 0x7f2420106620 2024-01-24T15:33:18.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.858+0000 7f2425400700 1 -- 172.21.15.5:0/3575051617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f242010aa50 con 0x7f2420106620 2024-01-24T15:33:18.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.861+0000 7f2417400700 1 -- 172.21.15.5:0/3575051617 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f241001f070 con 0x7f2420106620 2024-01-24T15:33:18.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.862+0000 7f2425400700 1 -- 172.21.15.5:0/3575051617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2420106620 msgr2=0x7f242019c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:18.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.862+0000 7f2425400700 1 --2- 172.21.15.5:0/3575051617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2420106620 0x7f242019c3f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2410000c00 tx=0x7f2410011e70 comp rx=0 tx=0).stop 2024-01-24T15:33:18.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.862+0000 7f2425400700 1 -- 172.21.15.5:0/3575051617 shutdown_connections 2024-01-24T15:33:18.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.862+0000 7f2425400700 1 --2- 172.21.15.5:0/3575051617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2420106620 0x7f242019c3f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:18.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.862+0000 7f2425400700 1 -- 172.21.15.5:0/3575051617 >> 172.21.15.5:0/3575051617 conn(0x7f2420101c00 msgr2=0x7f2420102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:18.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.862+0000 7f2425400700 1 -- 172.21.15.5:0/3575051617 shutdown_connections 2024-01-24T15:33:18.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:17.862+0000 7f2425400700 1 -- 172.21.15.5:0/3575051617 wait complete. 2024-01-24T15:33:18.200 INFO:teuthology.orchestra.run.smithi005.stdout:Wrote config to /etc/ceph/ceph.conf 2024-01-24T15:33:18.219 INFO:teuthology.orchestra.run.smithi005.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-01-24T15:33:18.220 INFO:teuthology.orchestra.run.smithi005.stdout:Creating mgr... 2024-01-24T15:33:18.220 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying port 0.0.0.0:9283 ... 2024-01-24T15:33:18.220 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying port 0.0.0.0:8765 ... 2024-01-24T15:33:18.562 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mgr.x 2024-01-24T15:33:18.562 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to reset failed state of unit ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mgr.x.service: Unit ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mgr.x.service not loaded. 2024-01-24T15:33:18.764 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-bede0bb6-bacd-11ee-95b1-87774f69a715.target.wants/ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mgr.x.service → /etc/systemd/system/ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@.service. 2024-01-24T15:33:18.864 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:18 smithi005 systemd[1]: Starting Ceph mgr.x for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:33:19.153 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:18 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/3575051617' entity='client.admin' 2024-01-24T15:33:19.301 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-01-24T15:33:19.301 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2024-01-24T15:33:19.317 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-01-24T15:33:19.317 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-01-24T15:33:19.317 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2024-01-24T15:33:19.317 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to enable service . firewalld.service is not available 2024-01-24T15:33:19.335 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-01-24T15:33:19.335 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2024-01-24T15:33:19.351 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-01-24T15:33:19.351 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-01-24T15:33:19.351 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2024-01-24T15:33:19.351 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-01-24T15:33:19.351 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr to start... 2024-01-24T15:33:19.351 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr... 2024-01-24T15:33:19.539 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:19 smithi005 bash[35580]: 04f8b1121c79f28326ad374385357b33154964b37d73954b08d3da5f49bbb63a 2024-01-24T15:33:19.539 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:19 smithi005 systemd[1]: Started Ceph mgr.x for bede0bb6-bacd-11ee-95b1-87774f69a715. 2024-01-24T15:33:20.085 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:19 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/2950475288' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-01-24T15:33:20.085 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:19 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:19.827+0000 7f9387aa8200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-24T15:33:20.085 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:19 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:19.955+0000 7f9387aa8200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-24T15:33:20.086 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:20 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:20.073+0000 7f9387aa8200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-24T15:33:20.209 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-01-24T15:33:20.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-01-24T15:33:20.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsid": "bede0bb6-bacd-11ee-95b1-87774f69a715", 2024-01-24T15:33:20.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "health": { 2024-01-24T15:33:20.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-01-24T15:33:20.210 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-01-24T15:33:20.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-01-24T15:33:20.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-01-24T15:33:20.212 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-01-24T15:33:20.213 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-01-24T15:33:20.213 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 0 2024-01-24T15:33:20.213 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-01-24T15:33:20.213 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-01-24T15:33:20.213 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "a" 2024-01-24T15:33:20.213 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-01-24T15:33:20.213 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-01-24T15:33:20.213 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "monmap": { 2024-01-24T15:33:20.213 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-24T15:33:20.213 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-01-24T15:33:20.213 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-01-24T15:33:20.213 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-01-24T15:33:20.214 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-01-24T15:33:20.214 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-24T15:33:20.214 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-01-24T15:33:20.214 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-01-24T15:33:20.222 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-01-24T15:33:20.222 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-01-24T15:33:20.222 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-01-24T15:33:20.222 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-01-24T15:33:20.222 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-01-24T15:33:20.222 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-01-24T15:33:20.222 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-01-24T15:33:20.222 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-01-24T15:33:20.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-01-24T15:33:20.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-01-24T15:33:20.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-01-24T15:33:20.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-01-24T15:33:20.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-01-24T15:33:20.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-01-24T15:33:20.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-01-24T15:33:20.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-01-24T15:33:20.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-24T15:33:20.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-01-24T15:33:20.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-01-24T15:33:20.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-01-24T15:33:20.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-01-24T15:33:20.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": false, 2024-01-24T15:33:20.223 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-01-24T15:33:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modules": [ 2024-01-24T15:33:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "iostat", 2024-01-24T15:33:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "nfs", 2024-01-24T15:33:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "restful" 2024-01-24T15:33:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-01-24T15:33:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-24T15:33:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-01-24T15:33:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-01-24T15:33:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-24T15:33:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modified": "2024-01-24T15:33:13.569594+0000", 2024-01-24T15:33:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-24T15:33:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-01-24T15:33:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-01-24T15:33:20.224 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-01-24T15:33:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.781+0000 7f0f90800700 1 Processor -- start 2024-01-24T15:33:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.781+0000 7f0f90800700 1 -- start start 2024-01-24T15:33:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.781+0000 7f0f90800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f8807ad60 0x7f0f880791c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.781+0000 7f0f90800700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f88079790 con 0x7f0f8807ad60 2024-01-24T15:33:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.782+0000 7f0f8de00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f8807ad60 0x7f0f880791c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.782+0000 7f0f8de00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f8807ad60 0x7f0f880791c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52232/0 (socket says 172.21.15.5:52232) 2024-01-24T15:33:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.782+0000 7f0f8de00700 1 -- 172.21.15.5:0/842485769 learned_addr learned my addr 172.21.15.5:0/842485769 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.782+0000 7f0f8de00700 1 -- 172.21.15.5:0/842485769 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f880798d0 con 0x7f0f8807ad60 2024-01-24T15:33:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.783+0000 7f0f8de00700 1 --2- 172.21.15.5:0/842485769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f8807ad60 0x7f0f880791c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0f780098a0 tx=0x7f0f78009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed4295ed27fb6303 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.783+0000 7f0f8ca00700 1 -- 172.21.15.5:0/842485769 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f78004160 con 0x7f0f8807ad60 2024-01-24T15:33:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.783+0000 7f0f8ca00700 1 -- 172.21.15.5:0/842485769 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f0f780042c0 con 0x7f0f8807ad60 2024-01-24T15:33:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.783+0000 7f0f8ca00700 1 -- 172.21.15.5:0/842485769 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f78011940 con 0x7f0f8807ad60 2024-01-24T15:33:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.783+0000 7f0f90800700 1 -- 172.21.15.5:0/842485769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f8807ad60 msgr2=0x7f0f880791c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:20.225 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.783+0000 7f0f90800700 1 --2- 172.21.15.5:0/842485769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f8807ad60 0x7f0f880791c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0f780098a0 tx=0x7f0f78009bb0 comp rx=0 tx=0).stop 2024-01-24T15:33:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.784+0000 7f0f90800700 1 -- 172.21.15.5:0/842485769 shutdown_connections 2024-01-24T15:33:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.784+0000 7f0f90800700 1 --2- 172.21.15.5:0/842485769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f8807ad60 0x7f0f880791c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.784+0000 7f0f90800700 1 -- 172.21.15.5:0/842485769 >> 172.21.15.5:0/842485769 conn(0x7f0f88101c00 msgr2=0x7f0f88104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.784+0000 7f0f90800700 1 -- 172.21.15.5:0/842485769 shutdown_connections 2024-01-24T15:33:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.784+0000 7f0f90800700 1 -- 172.21.15.5:0/842485769 wait complete. 2024-01-24T15:33:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.785+0000 7f0f90800700 1 Processor -- start 2024-01-24T15:33:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.785+0000 7f0f90800700 1 -- start start 2024-01-24T15:33:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.785+0000 7f0f90800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f8807ad60 0x7f0f8819c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.785+0000 7f0f90800700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8819c940 con 0x7f0f8807ad60 2024-01-24T15:33:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.786+0000 7f0f8de00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f8807ad60 0x7f0f8819c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.786+0000 7f0f8de00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f8807ad60 0x7f0f8819c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52240/0 (socket says 172.21.15.5:52240) 2024-01-24T15:33:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.786+0000 7f0f8de00700 1 -- 172.21.15.5:0/2950475288 learned_addr learned my addr 172.21.15.5:0/2950475288 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.786+0000 7f0f8de00700 1 -- 172.21.15.5:0/2950475288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f78009550 con 0x7f0f8807ad60 2024-01-24T15:33:20.226 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.786+0000 7f0f8de00700 1 --2- 172.21.15.5:0/2950475288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f8807ad60 0x7f0f8819c400 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0f78011dc0 tx=0x7f0f78011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.786+0000 7f0f86a00700 1 -- 172.21.15.5:0/2950475288 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f780037d0 con 0x7f0f8807ad60 2024-01-24T15:33:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.786+0000 7f0f86a00700 1 -- 172.21.15.5:0/2950475288 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f0f7801b440 con 0x7f0f8807ad60 2024-01-24T15:33:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.787+0000 7f0f90800700 1 -- 172.21.15.5:0/2950475288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f8819cb40 con 0x7f0f8807ad60 2024-01-24T15:33:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.787+0000 7f0f86a00700 1 -- 172.21.15.5:0/2950475288 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f7801a560 con 0x7f0f8807ad60 2024-01-24T15:33:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.787+0000 7f0f90800700 1 -- 172.21.15.5:0/2950475288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f8819cf60 con 0x7f0f8807ad60 2024-01-24T15:33:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.787+0000 7f0f86a00700 1 -- 172.21.15.5:0/2950475288 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0f7801aad0 con 0x7f0f8807ad60 2024-01-24T15:33:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.787+0000 7f0f86a00700 1 -- 172.21.15.5:0/2950475288 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0f780193f0 con 0x7f0f8807ad60 2024-01-24T15:33:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.788+0000 7f0f90800700 1 -- 172.21.15.5:0/2950475288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f88062370 con 0x7f0f8807ad60 2024-01-24T15:33:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.790+0000 7f0f86a00700 1 -- 172.21.15.5:0/2950475288 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f0f78029060 con 0x7f0f8807ad60 2024-01-24T15:33:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.866+0000 7f0f90800700 1 -- 172.21.15.5:0/2950475288 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f0f8819fa90 con 0x7f0f8807ad60 2024-01-24T15:33:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.866+0000 7f0f86a00700 1 -- 172.21.15.5:0/2950475288 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f0f7801f070 con 0x7f0f8807ad60 2024-01-24T15:33:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.867+0000 7f0f90800700 1 -- 172.21.15.5:0/2950475288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f8807ad60 msgr2=0x7f0f8819c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.867+0000 7f0f90800700 1 --2- 172.21.15.5:0/2950475288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f8807ad60 0x7f0f8819c400 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0f78011dc0 tx=0x7f0f78011ea0 comp rx=0 tx=0).stop 2024-01-24T15:33:20.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.868+0000 7f0f90800700 1 -- 172.21.15.5:0/2950475288 shutdown_connections 2024-01-24T15:33:20.228 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.868+0000 7f0f90800700 1 --2- 172.21.15.5:0/2950475288 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f8807ad60 0x7f0f8819c400 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:20.228 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.868+0000 7f0f90800700 1 -- 172.21.15.5:0/2950475288 >> 172.21.15.5:0/2950475288 conn(0x7f0f88101c00 msgr2=0x7f0f88102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:20.228 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.868+0000 7f0f90800700 1 -- 172.21.15.5:0/2950475288 shutdown_connections 2024-01-24T15:33:20.228 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:19.868+0000 7f0f90800700 1 -- 172.21.15.5:0/2950475288 wait complete. 2024-01-24T15:33:20.228 INFO:teuthology.orchestra.run.smithi005.stdout:mgr not available, waiting (1/15)... 2024-01-24T15:33:20.682 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:20 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:20.188+0000 7f9387aa8200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-24T15:33:21.363 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:21 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:21.058+0000 7f9387aa8200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-24T15:33:21.620 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:21 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:21.361+0000 7f9387aa8200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-24T15:33:21.620 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:21 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:21.475+0000 7f9387aa8200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-24T15:33:21.932 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:21 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:21.617+0000 7f9387aa8200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-24T15:33:21.933 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:21 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:21.817+0000 7f9387aa8200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-24T15:33:22.364 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:21 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:21.992+0000 7f9387aa8200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-24T15:33:22.364 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:22 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:22.106+0000 7f9387aa8200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-24T15:33:22.682 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:22 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:22.607+0000 7f9387aa8200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-24T15:33:23.042 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-01-24T15:33:23.043 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-01-24T15:33:23.043 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsid": "bede0bb6-bacd-11ee-95b1-87774f69a715", 2024-01-24T15:33:23.043 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "health": { 2024-01-24T15:33:23.043 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-01-24T15:33:23.043 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-01-24T15:33:23.043 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-01-24T15:33:23.043 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-01-24T15:33:23.043 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-01-24T15:33:23.043 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-01-24T15:33:23.043 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 0 2024-01-24T15:33:23.043 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-01-24T15:33:23.043 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-01-24T15:33:23.043 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "a" 2024-01-24T15:33:23.044 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-01-24T15:33:23.044 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-01-24T15:33:23.044 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "monmap": { 2024-01-24T15:33:23.044 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-24T15:33:23.044 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-01-24T15:33:23.044 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-01-24T15:33:23.044 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-01-24T15:33:23.044 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-01-24T15:33:23.044 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-24T15:33:23.044 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-01-24T15:33:23.044 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-01-24T15:33:23.044 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-01-24T15:33:23.053 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-01-24T15:33:23.053 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-01-24T15:33:23.053 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-01-24T15:33:23.053 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-01-24T15:33:23.053 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-01-24T15:33:23.053 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-01-24T15:33:23.053 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-01-24T15:33:23.053 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-01-24T15:33:23.053 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-01-24T15:33:23.053 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-01-24T15:33:23.053 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-01-24T15:33:23.053 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-01-24T15:33:23.053 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-01-24T15:33:23.054 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-01-24T15:33:23.054 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-01-24T15:33:23.054 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-24T15:33:23.054 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-01-24T15:33:23.054 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-01-24T15:33:23.054 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-01-24T15:33:23.054 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-01-24T15:33:23.054 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": false, 2024-01-24T15:33:23.054 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-01-24T15:33:23.054 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modules": [ 2024-01-24T15:33:23.054 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "iostat", 2024-01-24T15:33:23.054 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "nfs", 2024-01-24T15:33:23.054 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "restful" 2024-01-24T15:33:23.054 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-01-24T15:33:23.054 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-24T15:33:23.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-01-24T15:33:23.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-01-24T15:33:23.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-24T15:33:23.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modified": "2024-01-24T15:33:13.569594+0000", 2024-01-24T15:33:23.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-24T15:33:23.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-01-24T15:33:23.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-01-24T15:33:23.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-01-24T15:33:23.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.618+0000 7f6e18400700 1 Processor -- start 2024-01-24T15:33:23.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.618+0000 7f6e18400700 1 -- start start 2024-01-24T15:33:23.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.618+0000 7f6e18400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1007ad60 0x7f6e100791c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:23.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.618+0000 7f6e18400700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e10079790 con 0x7f6e1007ad60 2024-01-24T15:33:23.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.619+0000 7f6e15a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1007ad60 0x7f6e100791c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:23.055 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.619+0000 7f6e15a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1007ad60 0x7f6e100791c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36076/0 (socket says 172.21.15.5:36076) 2024-01-24T15:33:23.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.619+0000 7f6e15a00700 1 -- 172.21.15.5:0/2672063538 learned_addr learned my addr 172.21.15.5:0/2672063538 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:23.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.619+0000 7f6e15a00700 1 -- 172.21.15.5:0/2672063538 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e100798d0 con 0x7f6e1007ad60 2024-01-24T15:33:23.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.620+0000 7f6e15a00700 1 --2- 172.21.15.5:0/2672063538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1007ad60 0x7f6e100791c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6e000098a0 tx=0x7f6e00009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beae42eacaa069b6 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:23.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.620+0000 7f6e0fe00700 1 -- 172.21.15.5:0/2672063538 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e00004160 con 0x7f6e1007ad60 2024-01-24T15:33:23.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.620+0000 7f6e0fe00700 1 -- 172.21.15.5:0/2672063538 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f6e000042c0 con 0x7f6e1007ad60 2024-01-24T15:33:23.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.620+0000 7f6e0fe00700 1 -- 172.21.15.5:0/2672063538 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e00011940 con 0x7f6e1007ad60 2024-01-24T15:33:23.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.620+0000 7f6e18400700 1 -- 172.21.15.5:0/2672063538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1007ad60 msgr2=0x7f6e100791c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:23.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.621+0000 7f6e18400700 1 --2- 172.21.15.5:0/2672063538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1007ad60 0x7f6e100791c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6e000098a0 tx=0x7f6e00009bb0 comp rx=0 tx=0).stop 2024-01-24T15:33:23.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.621+0000 7f6e18400700 1 -- 172.21.15.5:0/2672063538 shutdown_connections 2024-01-24T15:33:23.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.621+0000 7f6e18400700 1 --2- 172.21.15.5:0/2672063538 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1007ad60 0x7f6e100791c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:23.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.621+0000 7f6e18400700 1 -- 172.21.15.5:0/2672063538 >> 172.21.15.5:0/2672063538 conn(0x7f6e10101c00 msgr2=0x7f6e10104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:23.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.621+0000 7f6e18400700 1 -- 172.21.15.5:0/2672063538 shutdown_connections 2024-01-24T15:33:23.056 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.621+0000 7f6e18400700 1 -- 172.21.15.5:0/2672063538 wait complete. 2024-01-24T15:33:23.057 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.622+0000 7f6e18400700 1 Processor -- start 2024-01-24T15:33:23.057 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.622+0000 7f6e18400700 1 -- start start 2024-01-24T15:33:23.057 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.622+0000 7f6e18400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1007ad60 0x7f6e1019c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:23.057 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.622+0000 7f6e18400700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1019c940 con 0x7f6e1007ad60 2024-01-24T15:33:23.057 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.622+0000 7f6e15a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1007ad60 0x7f6e1019c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:23.057 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.623+0000 7f6e15a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1007ad60 0x7f6e1019c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36080/0 (socket says 172.21.15.5:36080) 2024-01-24T15:33:23.057 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.623+0000 7f6e15a00700 1 -- 172.21.15.5:0/573062801 learned_addr learned my addr 172.21.15.5:0/573062801 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:23.057 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.623+0000 7f6e15a00700 1 -- 172.21.15.5:0/573062801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e00009550 con 0x7f6e1007ad60 2024-01-24T15:33:23.057 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.623+0000 7f6e15a00700 1 --2- 172.21.15.5:0/573062801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1007ad60 0x7f6e1019c400 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6e00011dc0 tx=0x7f6e00011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:23.057 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.623+0000 7f6e0e000700 1 -- 172.21.15.5:0/573062801 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e000037d0 con 0x7f6e1007ad60 2024-01-24T15:33:23.057 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.623+0000 7f6e0e000700 1 -- 172.21.15.5:0/573062801 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f6e0001b440 con 0x7f6e1007ad60 2024-01-24T15:33:23.057 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.623+0000 7f6e18400700 1 -- 172.21.15.5:0/573062801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1019cb40 con 0x7f6e1007ad60 2024-01-24T15:33:23.057 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.623+0000 7f6e0e000700 1 -- 172.21.15.5:0/573062801 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e0001a560 con 0x7f6e1007ad60 2024-01-24T15:33:23.058 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.624+0000 7f6e18400700 1 -- 172.21.15.5:0/573062801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1019cf60 con 0x7f6e1007ad60 2024-01-24T15:33:23.058 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.624+0000 7f6e0e000700 1 -- 172.21.15.5:0/573062801 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6e0001aad0 con 0x7f6e1007ad60 2024-01-24T15:33:23.058 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.624+0000 7f6e0e000700 1 -- 172.21.15.5:0/573062801 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6e000193f0 con 0x7f6e1007ad60 2024-01-24T15:33:23.058 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.625+0000 7f6e18400700 1 -- 172.21.15.5:0/573062801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e1010c9b0 con 0x7f6e1007ad60 2024-01-24T15:33:23.058 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.627+0000 7f6e0e000700 1 -- 172.21.15.5:0/573062801 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f6e00029060 con 0x7f6e1007ad60 2024-01-24T15:33:23.058 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.703+0000 7f6e18400700 1 -- 172.21.15.5:0/573062801 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f6e1010cba0 con 0x7f6e1007ad60 2024-01-24T15:33:23.058 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.704+0000 7f6e0e000700 1 -- 172.21.15.5:0/573062801 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f6e0001f070 con 0x7f6e1007ad60 2024-01-24T15:33:23.058 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.705+0000 7f6e18400700 1 -- 172.21.15.5:0/573062801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1007ad60 msgr2=0x7f6e1019c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:23.058 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.705+0000 7f6e18400700 1 --2- 172.21.15.5:0/573062801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1007ad60 0x7f6e1019c400 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6e00011dc0 tx=0x7f6e00011ea0 comp rx=0 tx=0).stop 2024-01-24T15:33:23.058 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.705+0000 7f6e18400700 1 -- 172.21.15.5:0/573062801 shutdown_connections 2024-01-24T15:33:23.058 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.705+0000 7f6e18400700 1 --2- 172.21.15.5:0/573062801 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6e1007ad60 0x7f6e1019c400 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:23.058 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.705+0000 7f6e18400700 1 -- 172.21.15.5:0/573062801 >> 172.21.15.5:0/573062801 conn(0x7f6e10101c00 msgr2=0x7f6e10102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:23.058 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.705+0000 7f6e18400700 1 -- 172.21.15.5:0/573062801 shutdown_connections 2024-01-24T15:33:23.058 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:22.705+0000 7f6e18400700 1 -- 172.21.15.5:0/573062801 wait complete. 2024-01-24T15:33:23.059 INFO:teuthology.orchestra.run.smithi005.stdout:mgr not available, waiting (2/15)... 2024-01-24T15:33:23.346 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:22 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:22.983+0000 7f9387aa8200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-24T15:33:23.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:23 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/573062801' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-01-24T15:33:23.683 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:23 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:23.344+0000 7f9387aa8200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-24T15:33:23.683 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:23 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:23.471+0000 7f9387aa8200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-24T15:33:24.771 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:24 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:24.443+0000 7f9387aa8200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-24T15:33:24.771 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:24 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:24.571+0000 7f9387aa8200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-24T15:33:25.182 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:24 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:24.768+0000 7f9387aa8200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-24T15:33:25.932 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:25 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:25.616+0000 7f9387aa8200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-24T15:33:25.933 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:25 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:25.858+0000 7f9387aa8200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-24T15:33:26.432 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:26 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:26.115+0000 7f9387aa8200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-24T15:33:27.654 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:27 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:27.292+0000 7f9387aa8200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-24T15:33:27.933 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:27 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:27.652+0000 7f9387aa8200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-24T15:33:27.933 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:27 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:27.770+0000 7f9387aa8200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-24T15:33:28.379 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:28 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:28.026+0000 7f9387aa8200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-24T15:33:28.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:28 smithi005 ceph-mon[35346]: Activating manager daemon x 2024-01-24T15:33:28.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:28 smithi005 ceph-mon[35346]: mgrmap e2: x(active, starting, since 0.00405415s) 2024-01-24T15:33:28.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:28 smithi005 ceph-mon[35346]: from='mgr.14100 172.21.15.5:0/466512376' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-24T15:33:28.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:28 smithi005 ceph-mon[35346]: from='mgr.14100 172.21.15.5:0/466512376' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-24T15:33:28.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:28 smithi005 ceph-mon[35346]: from='mgr.14100 172.21.15.5:0/466512376' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-24T15:33:28.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:28 smithi005 ceph-mon[35346]: from='mgr.14100 172.21.15.5:0/466512376' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-24T15:33:28.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:28 smithi005 ceph-mon[35346]: from='mgr.14100 172.21.15.5:0/466512376' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-24T15:33:28.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:28 smithi005 ceph-mon[35346]: Manager daemon x is now available 2024-01-24T15:33:28.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:28 smithi005 ceph-mon[35346]: from='mgr.14100 172.21.15.5:0/466512376' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-24T15:33:28.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:28 smithi005 ceph-mon[35346]: from='mgr.14100 172.21.15.5:0/466512376' entity='mgr.x' 2024-01-24T15:33:28.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:28 smithi005 ceph-mon[35346]: from='mgr.14100 172.21.15.5:0/466512376' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-24T15:33:28.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:28 smithi005 ceph-mon[35346]: from='mgr.14100 172.21.15.5:0/466512376' entity='mgr.x' 2024-01-24T15:33:28.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:28 smithi005 ceph-mon[35346]: from='mgr.14100 172.21.15.5:0/466512376' entity='mgr.x' 2024-01-24T15:33:30.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:30 smithi005 ceph-mon[35346]: mgrmap e3: x(active, since 1.00979s) 2024-01-24T15:33:31.432 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:31 smithi005 ceph-mon[35346]: mgrmap e4: x(active, since 2s) 2024-01-24T15:33:32.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:32 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/383535658' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-01-24T15:33:33.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-01-24T15:33:33.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-01-24T15:33:33.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsid": "bede0bb6-bacd-11ee-95b1-87774f69a715", 2024-01-24T15:33:33.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "health": { 2024-01-24T15:33:33.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-01-24T15:33:33.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-01-24T15:33:33.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-01-24T15:33:33.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-01-24T15:33:33.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-01-24T15:33:33.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-01-24T15:33:33.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 0 2024-01-24T15:33:33.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-01-24T15:33:33.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-01-24T15:33:33.009 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "a" 2024-01-24T15:33:33.010 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-01-24T15:33:33.010 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2024-01-24T15:33:33.010 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "monmap": { 2024-01-24T15:33:33.010 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-24T15:33:33.010 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-01-24T15:33:33.010 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-01-24T15:33:33.010 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-01-24T15:33:33.010 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-01-24T15:33:33.010 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-24T15:33:33.010 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-01-24T15:33:33.011 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-01-24T15:33:33.011 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-01-24T15:33:33.019 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-01-24T15:33:33.020 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-01-24T15:33:33.020 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-01-24T15:33:33.020 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-01-24T15:33:33.020 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-01-24T15:33:33.020 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-01-24T15:33:33.020 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-01-24T15:33:33.020 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-01-24T15:33:33.020 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-01-24T15:33:33.020 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-01-24T15:33:33.020 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-01-24T15:33:33.020 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-01-24T15:33:33.021 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-01-24T15:33:33.021 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-01-24T15:33:33.021 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-01-24T15:33:33.021 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-24T15:33:33.021 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-01-24T15:33:33.021 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-01-24T15:33:33.021 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-01-24T15:33:33.021 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-01-24T15:33:33.021 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": true, 2024-01-24T15:33:33.021 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-01-24T15:33:33.021 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modules": [ 2024-01-24T15:33:33.021 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "iostat", 2024-01-24T15:33:33.021 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "nfs", 2024-01-24T15:33:33.021 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "restful" 2024-01-24T15:33:33.022 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-01-24T15:33:33.022 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-24T15:33:33.022 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-01-24T15:33:33.022 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-01-24T15:33:33.022 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-24T15:33:33.022 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modified": "2024-01-24T15:33:13.569594+0000", 2024-01-24T15:33:33.022 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-24T15:33:33.022 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-01-24T15:33:33.022 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-01-24T15:33:33.022 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-01-24T15:33:33.022 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.783+0000 7f2bb1200700 1 Processor -- start 2024-01-24T15:33:33.022 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.783+0000 7f2bb1200700 1 -- start start 2024-01-24T15:33:33.022 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.784+0000 7f2bb1200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bac1070f0 0x7f2bac1094e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:33.022 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.784+0000 7f2bb1200700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac0744c0 con 0x7f2bac1070f0 2024-01-24T15:33:33.023 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.784+0000 7f2ba9e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bac1070f0 0x7f2bac1094e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:33.023 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.784+0000 7f2ba9e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bac1070f0 0x7f2bac1094e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36136/0 (socket says 172.21.15.5:36136) 2024-01-24T15:33:33.023 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.784+0000 7f2ba9e00700 1 -- 172.21.15.5:0/1339470336 learned_addr learned my addr 172.21.15.5:0/1339470336 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:33.023 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.784+0000 7f2ba9e00700 1 -- 172.21.15.5:0/1339470336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bac109a20 con 0x7f2bac1070f0 2024-01-24T15:33:33.023 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.785+0000 7f2ba9e00700 1 --2- 172.21.15.5:0/1339470336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bac1070f0 0x7f2bac1094e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c0098a0 tx=0x7f2b9c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ab14e1972628e9 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:33.023 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.785+0000 7f2ba8a00700 1 -- 172.21.15.5:0/1339470336 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b9c004160 con 0x7f2bac1070f0 2024-01-24T15:33:33.023 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.785+0000 7f2ba8a00700 1 -- 172.21.15.5:0/1339470336 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f2b9c0042c0 con 0x7f2bac1070f0 2024-01-24T15:33:33.023 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.785+0000 7f2ba8a00700 1 -- 172.21.15.5:0/1339470336 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b9c011940 con 0x7f2bac1070f0 2024-01-24T15:33:33.023 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.785+0000 7f2bb1200700 1 -- 172.21.15.5:0/1339470336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bac1070f0 msgr2=0x7f2bac1094e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:33.023 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.785+0000 7f2bb1200700 1 --2- 172.21.15.5:0/1339470336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bac1070f0 0x7f2bac1094e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c0098a0 tx=0x7f2b9c009bb0 comp rx=0 tx=0).stop 2024-01-24T15:33:33.023 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.786+0000 7f2bb1200700 1 -- 172.21.15.5:0/1339470336 shutdown_connections 2024-01-24T15:33:33.023 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.786+0000 7f2bb1200700 1 --2- 172.21.15.5:0/1339470336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bac1070f0 0x7f2bac1094e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:33.023 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.786+0000 7f2bb1200700 1 -- 172.21.15.5:0/1339470336 >> 172.21.15.5:0/1339470336 conn(0x7f2bac100b20 msgr2=0x7f2bac102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:33.023 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.786+0000 7f2bb1200700 1 -- 172.21.15.5:0/1339470336 shutdown_connections 2024-01-24T15:33:33.024 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.786+0000 7f2bb1200700 1 -- 172.21.15.5:0/1339470336 wait complete. 2024-01-24T15:33:33.024 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.787+0000 7f2bb1200700 1 Processor -- start 2024-01-24T15:33:33.024 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.787+0000 7f2bb1200700 1 -- start start 2024-01-24T15:33:33.024 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.787+0000 7f2bb1200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bac1070f0 0x7f2bac19c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:33.024 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.787+0000 7f2bb1200700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac19c900 con 0x7f2bac1070f0 2024-01-24T15:33:33.024 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.787+0000 7f2ba9e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bac1070f0 0x7f2bac19c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:33.024 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.787+0000 7f2ba9e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bac1070f0 0x7f2bac19c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36150/0 (socket says 172.21.15.5:36150) 2024-01-24T15:33:33.024 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.787+0000 7f2ba9e00700 1 -- 172.21.15.5:0/383535658 learned_addr learned my addr 172.21.15.5:0/383535658 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:33.024 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.788+0000 7f2ba9e00700 1 -- 172.21.15.5:0/383535658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9c009550 con 0x7f2bac1070f0 2024-01-24T15:33:33.024 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.788+0000 7f2ba9e00700 1 --2- 172.21.15.5:0/383535658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bac1070f0 0x7f2bac19c3c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c011dc0 tx=0x7f2b9c011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:33.024 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.788+0000 7f2ba2a00700 1 -- 172.21.15.5:0/383535658 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b9c0037d0 con 0x7f2bac1070f0 2024-01-24T15:33:33.024 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.788+0000 7f2ba2a00700 1 -- 172.21.15.5:0/383535658 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f2b9c01b440 con 0x7f2bac1070f0 2024-01-24T15:33:33.024 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.788+0000 7f2bb1200700 1 -- 172.21.15.5:0/383535658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bac19cb00 con 0x7f2bac1070f0 2024-01-24T15:33:33.024 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.788+0000 7f2ba2a00700 1 -- 172.21.15.5:0/383535658 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b9c01a560 con 0x7f2bac1070f0 2024-01-24T15:33:33.025 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.788+0000 7f2bb1200700 1 -- 172.21.15.5:0/383535658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bac19cf20 con 0x7f2bac1070f0 2024-01-24T15:33:33.025 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.789+0000 7f2ba2a00700 1 -- 172.21.15.5:0/383535658 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 45257+0+0 (secure 0 0 0) 0x7f2b9c01b5b0 con 0x7f2bac1070f0 2024-01-24T15:33:33.025 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.789+0000 7f2bb1200700 1 -- 172.21.15.5:0/383535658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bac10a760 con 0x7f2bac1070f0 2024-01-24T15:33:33.025 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.790+0000 7f2ba2a00700 1 --2- 172.21.15.5:0/383535658 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f2b8c038300 0x7f2b8c03a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:33.025 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.790+0000 7f2ba2a00700 1 -- 172.21.15.5:0/383535658 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2b9c04bfb0 con 0x7f2bac1070f0 2024-01-24T15:33:33.025 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.790+0000 7f2ba9400700 1 --2- 172.21.15.5:0/383535658 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f2b8c038300 0x7f2b8c03a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:33.025 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.791+0000 7f2ba9400700 1 --2- 172.21.15.5:0/383535658 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f2b8c038300 0x7f2b8c03a7c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2b94006fd0 tx=0x7f2b94006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:33.025 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:30.795+0000 7f2ba2a00700 1 -- 172.21.15.5:0/383535658 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f2b9c023590 con 0x7f2bac1070f0 2024-01-24T15:33:33.025 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:31.084+0000 7f2bb1200700 1 -- 172.21.15.5:0/383535658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f2bac10a950 con 0x7f2bac1070f0 2024-01-24T15:33:33.025 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:31.085+0000 7f2ba2a00700 1 -- 172.21.15.5:0/383535658 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f2b9c01f070 con 0x7f2bac1070f0 2024-01-24T15:33:33.025 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:31.087+0000 7f2bb1200700 1 -- 172.21.15.5:0/383535658 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f2b8c038300 msgr2=0x7f2b8c03a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:33.025 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:31.087+0000 7f2bb1200700 1 --2- 172.21.15.5:0/383535658 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f2b8c038300 0x7f2b8c03a7c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2b94006fd0 tx=0x7f2b94006e40 comp rx=0 tx=0).stop 2024-01-24T15:33:33.025 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:31.087+0000 7f2bb1200700 1 -- 172.21.15.5:0/383535658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bac1070f0 msgr2=0x7f2bac19c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:33.025 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:31.087+0000 7f2bb1200700 1 --2- 172.21.15.5:0/383535658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bac1070f0 0x7f2bac19c3c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c011dc0 tx=0x7f2b9c011ea0 comp rx=0 tx=0).stop 2024-01-24T15:33:33.025 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:31.087+0000 7f2bb1200700 1 -- 172.21.15.5:0/383535658 shutdown_connections 2024-01-24T15:33:33.025 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:31.087+0000 7f2bb1200700 1 --2- 172.21.15.5:0/383535658 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f2b8c038300 0x7f2b8c03a7c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:33.026 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:31.087+0000 7f2bb1200700 1 --2- 172.21.15.5:0/383535658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2bac1070f0 0x7f2bac19c3c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:33.026 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:31.087+0000 7f2bb1200700 1 -- 172.21.15.5:0/383535658 >> 172.21.15.5:0/383535658 conn(0x7f2bac100b20 msgr2=0x7f2bac101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:33.026 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:31.087+0000 7f2bb1200700 1 -- 172.21.15.5:0/383535658 shutdown_connections 2024-01-24T15:33:33.026 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:31.087+0000 7f2bb1200700 1 -- 172.21.15.5:0/383535658 wait complete. 2024-01-24T15:33:33.026 INFO:teuthology.orchestra.run.smithi005.stdout:mgr is available 2024-01-24T15:33:33.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:33 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/801485833' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-01-24T15:33:33.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-01-24T15:33:33.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [global] 2024-01-24T15:33:33.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout fsid = bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:33:33.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-01-24T15:33:33.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-01-24T15:33:33.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-01-24T15:33:33.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-01-24T15:33:33.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-01-24T15:33:33.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [mgr] 2024-01-24T15:33:33.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-01-24T15:33:33.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-01-24T15:33:33.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [osd] 2024-01-24T15:33:33.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-01-24T15:33:33.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-01-24T15:33:33.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-01-24T15:33:33.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-01-24T15:33:33.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-01-24T15:33:33.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.409+0000 7f6a5c400700 1 Processor -- start 2024-01-24T15:33:33.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.409+0000 7f6a5c400700 1 -- start start 2024-01-24T15:33:33.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.410+0000 7f6a5c400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a54106620 0x7f6a54106a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:33.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.410+0000 7f6a5c400700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a54107010 con 0x7f6a54106620 2024-01-24T15:33:33.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.410+0000 7f6a59a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a54106620 0x7f6a54106a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:33.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.410+0000 7f6a59a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a54106620 0x7f6a54106a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56228/0 (socket says 172.21.15.5:56228) 2024-01-24T15:33:33.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.410+0000 7f6a59a00700 1 -- 172.21.15.5:0/692807619 learned_addr learned my addr 172.21.15.5:0/692807619 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:33.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.410+0000 7f6a59a00700 1 -- 172.21.15.5:0/692807619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a54107820 con 0x7f6a54106620 2024-01-24T15:33:33.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.411+0000 7f6a59a00700 1 --2- 172.21.15.5:0/692807619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a54106620 0x7f6a54106a40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6a440098a0 tx=0x7f6a44009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217d956cf1c5a4d server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:33.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.411+0000 7f6a53e00700 1 -- 172.21.15.5:0/692807619 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a44004160 con 0x7f6a54106620 2024-01-24T15:33:33.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.411+0000 7f6a53e00700 1 -- 172.21.15.5:0/692807619 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f6a440042c0 con 0x7f6a54106620 2024-01-24T15:33:33.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.411+0000 7f6a53e00700 1 -- 172.21.15.5:0/692807619 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a44011940 con 0x7f6a54106620 2024-01-24T15:33:33.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.411+0000 7f6a5c400700 1 -- 172.21.15.5:0/692807619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a54106620 msgr2=0x7f6a54106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:33.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.411+0000 7f6a5c400700 1 --2- 172.21.15.5:0/692807619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a54106620 0x7f6a54106a40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6a440098a0 tx=0x7f6a44009bb0 comp rx=0 tx=0).stop 2024-01-24T15:33:33.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.412+0000 7f6a5c400700 1 -- 172.21.15.5:0/692807619 shutdown_connections 2024-01-24T15:33:33.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.412+0000 7f6a5c400700 1 --2- 172.21.15.5:0/692807619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a54106620 0x7f6a54106a40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:33.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.412+0000 7f6a5c400700 1 -- 172.21.15.5:0/692807619 >> 172.21.15.5:0/692807619 conn(0x7f6a54101c00 msgr2=0x7f6a54104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:33.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.412+0000 7f6a5c400700 1 -- 172.21.15.5:0/692807619 shutdown_connections 2024-01-24T15:33:33.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.412+0000 7f6a5c400700 1 -- 172.21.15.5:0/692807619 wait complete. 2024-01-24T15:33:33.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.413+0000 7f6a5c400700 1 Processor -- start 2024-01-24T15:33:33.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.413+0000 7f6a5c400700 1 -- start start 2024-01-24T15:33:33.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.413+0000 7f6a5c400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a54106620 0x7f6a5419c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:33.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.413+0000 7f6a5c400700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5419c930 con 0x7f6a54106620 2024-01-24T15:33:33.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.413+0000 7f6a59a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a54106620 0x7f6a5419c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:33.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.413+0000 7f6a59a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a54106620 0x7f6a5419c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56232/0 (socket says 172.21.15.5:56232) 2024-01-24T15:33:33.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.413+0000 7f6a59a00700 1 -- 172.21.15.5:0/801485833 learned_addr learned my addr 172.21.15.5:0/801485833 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:33.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.414+0000 7f6a59a00700 1 -- 172.21.15.5:0/801485833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a44009550 con 0x7f6a54106620 2024-01-24T15:33:33.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.414+0000 7f6a59a00700 1 --2- 172.21.15.5:0/801485833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a54106620 0x7f6a5419c3f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6a44000c00 tx=0x7f6a44011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:33.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.414+0000 7f6a52000700 1 -- 172.21.15.5:0/801485833 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a440036a0 con 0x7f6a54106620 2024-01-24T15:33:33.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.414+0000 7f6a52000700 1 -- 172.21.15.5:0/801485833 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f6a4401b440 con 0x7f6a54106620 2024-01-24T15:33:33.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.414+0000 7f6a52000700 1 -- 172.21.15.5:0/801485833 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a440193f0 con 0x7f6a54106620 2024-01-24T15:33:33.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.414+0000 7f6a5c400700 1 -- 172.21.15.5:0/801485833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a5419cb30 con 0x7f6a54106620 2024-01-24T15:33:33.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.414+0000 7f6a5c400700 1 -- 172.21.15.5:0/801485833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5419cf50 con 0x7f6a54106620 2024-01-24T15:33:33.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.415+0000 7f6a52000700 1 -- 172.21.15.5:0/801485833 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 45257+0+0 (secure 0 0 0) 0x7f6a4401b5b0 con 0x7f6a54106620 2024-01-24T15:33:33.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.415+0000 7f6a5c400700 1 -- 172.21.15.5:0/801485833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a54062370 con 0x7f6a54106620 2024-01-24T15:33:33.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.416+0000 7f6a52000700 1 --2- 172.21.15.5:0/801485833 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f6a34038300 0x7f6a3403a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:33.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.416+0000 7f6a52000700 1 -- 172.21.15.5:0/801485833 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6a4404c000 con 0x7f6a54106620 2024-01-24T15:33:33.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.416+0000 7f6a59000700 1 --2- 172.21.15.5:0/801485833 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f6a34038300 0x7f6a3403a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:33.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.417+0000 7f6a59000700 1 --2- 172.21.15.5:0/801485833 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f6a34038300 0x7f6a3403a7c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c006fd0 tx=0x7f6a3c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:33.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.421+0000 7f6a52000700 1 -- 172.21.15.5:0/801485833 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f6a44022950 con 0x7f6a54106620 2024-01-24T15:33:33.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.627+0000 7f6a5c400700 1 -- 172.21.15.5:0/801485833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f6a5419fdb0 con 0x7f6a54106620 2024-01-24T15:33:33.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.628+0000 7f6a52000700 1 -- 172.21.15.5:0/801485833 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f6a4401f070 con 0x7f6a54106620 2024-01-24T15:33:33.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.630+0000 7f6a5c400700 1 -- 172.21.15.5:0/801485833 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f6a34038300 msgr2=0x7f6a3403a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:33.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.630+0000 7f6a5c400700 1 --2- 172.21.15.5:0/801485833 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f6a34038300 0x7f6a3403a7c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c006fd0 tx=0x7f6a3c006e40 comp rx=0 tx=0).stop 2024-01-24T15:33:33.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.630+0000 7f6a5c400700 1 -- 172.21.15.5:0/801485833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a54106620 msgr2=0x7f6a5419c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:33.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.630+0000 7f6a5c400700 1 --2- 172.21.15.5:0/801485833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a54106620 0x7f6a5419c3f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6a44000c00 tx=0x7f6a44011e70 comp rx=0 tx=0).stop 2024-01-24T15:33:33.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.630+0000 7f6a5c400700 1 -- 172.21.15.5:0/801485833 shutdown_connections 2024-01-24T15:33:33.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.630+0000 7f6a5c400700 1 --2- 172.21.15.5:0/801485833 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f6a34038300 0x7f6a3403a7c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:33.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.630+0000 7f6a5c400700 1 --2- 172.21.15.5:0/801485833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a54106620 0x7f6a5419c3f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:33.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.630+0000 7f6a5c400700 1 -- 172.21.15.5:0/801485833 >> 172.21.15.5:0/801485833 conn(0x7f6a54101c00 msgr2=0x7f6a54102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:33.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.631+0000 7f6a5c400700 1 -- 172.21.15.5:0/801485833 shutdown_connections 2024-01-24T15:33:33.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:33.631+0000 7f6a5c400700 1 -- 172.21.15.5:0/801485833 wait complete. 2024-01-24T15:33:33.985 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling cephadm module... 2024-01-24T15:33:34.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:34 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/3477555603' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-01-24T15:33:34.933 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:34 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: ignoring --setuser ceph since I am not root 2024-01-24T15:33:34.933 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:34 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: ignoring --setgroup ceph since I am not root 2024-01-24T15:33:34.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.361+0000 7f4836a00700 1 Processor -- start 2024-01-24T15:33:34.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.361+0000 7f4836a00700 1 -- start start 2024-01-24T15:33:34.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.361+0000 7f4836a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483007ad80 0x7f48300791e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:34.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.361+0000 7f4836a00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48300797b0 con 0x7f483007ad80 2024-01-24T15:33:34.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.362+0000 7f4835600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483007ad80 0x7f48300791e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:34.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.362+0000 7f4835600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483007ad80 0x7f48300791e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56244/0 (socket says 172.21.15.5:56244) 2024-01-24T15:33:34.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.362+0000 7f4835600700 1 -- 172.21.15.5:0/150442275 learned_addr learned my addr 172.21.15.5:0/150442275 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:34.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.362+0000 7f4835600700 1 -- 172.21.15.5:0/150442275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48300798f0 con 0x7f483007ad80 2024-01-24T15:33:34.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.362+0000 7f4835600700 1 --2- 172.21.15.5:0/150442275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483007ad80 0x7f48300791e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f48200098a0 tx=0x7f4820009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a5bb77b8d901d6 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:34.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.363+0000 7f482fe00700 1 -- 172.21.15.5:0/150442275 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4820004160 con 0x7f483007ad80 2024-01-24T15:33:34.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.363+0000 7f482fe00700 1 -- 172.21.15.5:0/150442275 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f48200042c0 con 0x7f483007ad80 2024-01-24T15:33:34.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.363+0000 7f482fe00700 1 -- 172.21.15.5:0/150442275 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4820011940 con 0x7f483007ad80 2024-01-24T15:33:34.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.363+0000 7f4836a00700 1 -- 172.21.15.5:0/150442275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483007ad80 msgr2=0x7f48300791e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:34.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.363+0000 7f4836a00700 1 --2- 172.21.15.5:0/150442275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483007ad80 0x7f48300791e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f48200098a0 tx=0x7f4820009bb0 comp rx=0 tx=0).stop 2024-01-24T15:33:34.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.363+0000 7f4836a00700 1 -- 172.21.15.5:0/150442275 shutdown_connections 2024-01-24T15:33:34.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.363+0000 7f4836a00700 1 --2- 172.21.15.5:0/150442275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483007ad80 0x7f48300791e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:34.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.363+0000 7f4836a00700 1 -- 172.21.15.5:0/150442275 >> 172.21.15.5:0/150442275 conn(0x7f4830101a00 msgr2=0x7f4830103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:34.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.363+0000 7f4836a00700 1 -- 172.21.15.5:0/150442275 shutdown_connections 2024-01-24T15:33:34.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.364+0000 7f4836a00700 1 -- 172.21.15.5:0/150442275 wait complete. 2024-01-24T15:33:34.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.365+0000 7f4836a00700 1 Processor -- start 2024-01-24T15:33:34.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.365+0000 7f4836a00700 1 -- start start 2024-01-24T15:33:34.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.366+0000 7f4836a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483007ad80 0x7f483019c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:34.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.366+0000 7f4836a00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483019c720 con 0x7f483007ad80 2024-01-24T15:33:34.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.366+0000 7f4835600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483007ad80 0x7f483019c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:34.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.366+0000 7f4835600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483007ad80 0x7f483019c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56252/0 (socket says 172.21.15.5:56252) 2024-01-24T15:33:34.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.366+0000 7f4835600700 1 -- 172.21.15.5:0/3477555603 learned_addr learned my addr 172.21.15.5:0/3477555603 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:34.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.366+0000 7f4835600700 1 -- 172.21.15.5:0/3477555603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4820009550 con 0x7f483007ad80 2024-01-24T15:33:34.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.366+0000 7f4835600700 1 --2- 172.21.15.5:0/3477555603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483007ad80 0x7f483019c1e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4820000c00 tx=0x7f4820011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:34.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.367+0000 7f482e000700 1 -- 172.21.15.5:0/3477555603 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48200036a0 con 0x7f483007ad80 2024-01-24T15:33:34.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.367+0000 7f482e000700 1 -- 172.21.15.5:0/3477555603 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f482001b440 con 0x7f483007ad80 2024-01-24T15:33:34.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.367+0000 7f482e000700 1 -- 172.21.15.5:0/3477555603 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48200193f0 con 0x7f483007ad80 2024-01-24T15:33:34.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.367+0000 7f4836a00700 1 -- 172.21.15.5:0/3477555603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f483019c920 con 0x7f483007ad80 2024-01-24T15:33:34.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.367+0000 7f4836a00700 1 -- 172.21.15.5:0/3477555603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f483019cd40 con 0x7f483007ad80 2024-01-24T15:33:34.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.368+0000 7f482e000700 1 -- 172.21.15.5:0/3477555603 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 4) v1 ==== 45257+0+0 (secure 0 0 0) 0x7f482001b5b0 con 0x7f483007ad80 2024-01-24T15:33:34.984 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.368+0000 7f4836a00700 1 -- 172.21.15.5:0/3477555603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48300623e0 con 0x7f483007ad80 2024-01-24T15:33:34.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.368+0000 7f482e000700 1 --2- 172.21.15.5:0/3477555603 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f4810038300 0x7f481003a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:34.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.368+0000 7f482e000700 1 -- 172.21.15.5:0/3477555603 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f482004c000 con 0x7f483007ad80 2024-01-24T15:33:34.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.369+0000 7f4834c00700 1 --2- 172.21.15.5:0/3477555603 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f4810038300 0x7f481003a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:34.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.369+0000 7f4834c00700 1 --2- 172.21.15.5:0/3477555603 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f4810038300 0x7f481003a7c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4818006fd0 tx=0x7f4818006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:34.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.373+0000 7f482e000700 1 -- 172.21.15.5:0/3477555603 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f48300623e0 con 0x7f483007ad80 2024-01-24T15:33:34.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.636+0000 7f4836a00700 1 -- 172.21.15.5:0/3477555603 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f4830062370 con 0x7f483007ad80 2024-01-24T15:33:34.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.684+0000 7f482e000700 1 -- 172.21.15.5:0/3477555603 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 5) v1 ==== 45268+0+0 (secure 0 0 0) 0x7f4820003940 con 0x7f483007ad80 2024-01-24T15:33:34.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.686+0000 7f482e000700 1 -- 172.21.15.5:0/3477555603 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f4820022720 con 0x7f483007ad80 2024-01-24T15:33:34.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.689+0000 7f4836a00700 1 -- 172.21.15.5:0/3477555603 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f4810038300 msgr2=0x7f481003a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:34.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.689+0000 7f4836a00700 1 --2- 172.21.15.5:0/3477555603 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f4810038300 0x7f481003a7c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4818006fd0 tx=0x7f4818006e40 comp rx=0 tx=0).stop 2024-01-24T15:33:34.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.689+0000 7f4836a00700 1 -- 172.21.15.5:0/3477555603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483007ad80 msgr2=0x7f483019c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:34.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.689+0000 7f4836a00700 1 --2- 172.21.15.5:0/3477555603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483007ad80 0x7f483019c1e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4820000c00 tx=0x7f4820011e70 comp rx=0 tx=0).stop 2024-01-24T15:33:34.985 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.689+0000 7f4836a00700 1 -- 172.21.15.5:0/3477555603 shutdown_connections 2024-01-24T15:33:34.986 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.689+0000 7f4836a00700 1 --2- 172.21.15.5:0/3477555603 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f4810038300 0x7f481003a7c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:34.986 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.689+0000 7f4836a00700 1 --2- 172.21.15.5:0/3477555603 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f483007ad80 0x7f483019c1e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:34.986 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.689+0000 7f4836a00700 1 -- 172.21.15.5:0/3477555603 >> 172.21.15.5:0/3477555603 conn(0x7f4830101a00 msgr2=0x7f4830102760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:34.986 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.689+0000 7f4836a00700 1 -- 172.21.15.5:0/3477555603 shutdown_connections 2024-01-24T15:33:34.986 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:34.689+0000 7f4836a00700 1 -- 172.21.15.5:0/3477555603 wait complete. 2024-01-24T15:33:35.683 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:35 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:35.329+0000 7f3dfd5ee200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-24T15:33:35.683 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:35 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:35.454+0000 7f3dfd5ee200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-24T15:33:35.683 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:35 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:35.571+0000 7f3dfd5ee200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-24T15:33:35.982 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:35 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/3477555603' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-01-24T15:33:35.982 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:35 smithi005 ceph-mon[35346]: mgrmap e5: x(active, since 6s) 2024-01-24T15:33:35.982 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:35 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/1419247983' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-01-24T15:33:35.982 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:35 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:35.685+0000 7f3dfd5ee200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-24T15:33:35.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-01-24T15:33:35.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-01-24T15:33:35.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": true, 2024-01-24T15:33:35.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-01-24T15:33:35.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-01-24T15:33:35.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-01-24T15:33:35.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.379+0000 7f71a9800700 1 Processor -- start 2024-01-24T15:33:35.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.379+0000 7f71a9800700 1 -- start start 2024-01-24T15:33:35.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.379+0000 7f71a9800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71a4106630 0x7f71a4106a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:35.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.379+0000 7f71a9800700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a4107020 con 0x7f71a4106630 2024-01-24T15:33:35.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.380+0000 7f71a2a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71a4106630 0x7f71a4106a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:35.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.380+0000 7f71a2a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71a4106630 0x7f71a4106a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56266/0 (socket says 172.21.15.5:56266) 2024-01-24T15:33:35.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.380+0000 7f71a2a00700 1 -- 172.21.15.5:0/1348512353 learned_addr learned my addr 172.21.15.5:0/1348512353 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:35.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.380+0000 7f71a2a00700 1 -- 172.21.15.5:0/1348512353 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a4107830 con 0x7f71a4106630 2024-01-24T15:33:35.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.380+0000 7f71a2a00700 1 --2- 172.21.15.5:0/1348512353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71a4106630 0x7f71a4106a50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f71940098a0 tx=0x7f7194009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2a5c701b8db02f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:35.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.381+0000 7f71a1600700 1 -- 172.21.15.5:0/1348512353 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7194004160 con 0x7f71a4106630 2024-01-24T15:33:35.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.381+0000 7f71a1600700 1 -- 172.21.15.5:0/1348512353 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f71940042c0 con 0x7f71a4106630 2024-01-24T15:33:35.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.381+0000 7f71a1600700 1 -- 172.21.15.5:0/1348512353 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7194011940 con 0x7f71a4106630 2024-01-24T15:33:35.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.382+0000 7f71a9800700 1 -- 172.21.15.5:0/1348512353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71a4106630 msgr2=0x7f71a4106a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:35.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.382+0000 7f71a9800700 1 --2- 172.21.15.5:0/1348512353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71a4106630 0x7f71a4106a50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f71940098a0 tx=0x7f7194009bb0 comp rx=0 tx=0).stop 2024-01-24T15:33:35.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.382+0000 7f71a9800700 1 -- 172.21.15.5:0/1348512353 shutdown_connections 2024-01-24T15:33:35.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.382+0000 7f71a9800700 1 --2- 172.21.15.5:0/1348512353 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71a4106630 0x7f71a4106a50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:35.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.382+0000 7f71a9800700 1 -- 172.21.15.5:0/1348512353 >> 172.21.15.5:0/1348512353 conn(0x7f71a4101c30 msgr2=0x7f71a4104050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:35.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.382+0000 7f71a9800700 1 -- 172.21.15.5:0/1348512353 shutdown_connections 2024-01-24T15:33:35.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.382+0000 7f71a9800700 1 -- 172.21.15.5:0/1348512353 wait complete. 2024-01-24T15:33:35.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.383+0000 7f71a9800700 1 Processor -- start 2024-01-24T15:33:35.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.383+0000 7f71a9800700 1 -- start start 2024-01-24T15:33:35.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.383+0000 7f71a9800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71a4106630 0x7f71a419c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:35.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.383+0000 7f71a9800700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a419c990 con 0x7f71a4106630 2024-01-24T15:33:35.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.384+0000 7f71a2a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71a4106630 0x7f71a419c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:35.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.384+0000 7f71a2a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71a4106630 0x7f71a419c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56276/0 (socket says 172.21.15.5:56276) 2024-01-24T15:33:35.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.384+0000 7f71a2a00700 1 -- 172.21.15.5:0/1419247983 learned_addr learned my addr 172.21.15.5:0/1419247983 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:35.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.384+0000 7f71a2a00700 1 -- 172.21.15.5:0/1419247983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7194009550 con 0x7f71a4106630 2024-01-24T15:33:35.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.384+0000 7f71a2a00700 1 --2- 172.21.15.5:0/1419247983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71a4106630 0x7f71a419c450 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7194000c00 tx=0x7f7194011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:35.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.384+0000 7f719b400700 1 -- 172.21.15.5:0/1419247983 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71940036a0 con 0x7f71a4106630 2024-01-24T15:33:35.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.385+0000 7f71a9800700 1 -- 172.21.15.5:0/1419247983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a419cb90 con 0x7f71a4106630 2024-01-24T15:33:35.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.385+0000 7f719b400700 1 -- 172.21.15.5:0/1419247983 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f7194003c70 con 0x7f71a4106630 2024-01-24T15:33:35.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.385+0000 7f719b400700 1 -- 172.21.15.5:0/1419247983 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71940193f0 con 0x7f71a4106630 2024-01-24T15:33:35.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.385+0000 7f71a9800700 1 -- 172.21.15.5:0/1419247983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a419cfb0 con 0x7f71a4106630 2024-01-24T15:33:35.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.386+0000 7f71a9800700 1 -- 172.21.15.5:0/1419247983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a4062370 con 0x7f71a4106630 2024-01-24T15:33:35.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.386+0000 7f719b400700 1 -- 172.21.15.5:0/1419247983 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 45268+0+0 (secure 0 0 0) 0x7f719401b440 con 0x7f71a4106630 2024-01-24T15:33:35.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.386+0000 7f719b400700 1 --2- 172.21.15.5:0/1419247983 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f7184038300 0x7f718403a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:35.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.386+0000 7f719b400700 1 -- 172.21.15.5:0/1419247983 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f719404bfe0 con 0x7f71a4106630 2024-01-24T15:33:35.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.386+0000 7f71a2000700 1 -- 172.21.15.5:0/1419247983 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f7184038300 msgr2=0x7f718403a7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1174207089 2024-01-24T15:33:35.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.386+0000 7f71a2000700 1 --2- 172.21.15.5:0/1419247983 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f7184038300 0x7f718403a7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-24T15:33:35.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.391+0000 7f719b400700 1 -- 172.21.15.5:0/1419247983 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f719407f120 con 0x7f71a4106630 2024-01-24T15:33:35.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.587+0000 7f71a2000700 1 -- 172.21.15.5:0/1419247983 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f7184038300 msgr2=0x7f718403a7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1174207089 2024-01-24T15:33:35.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.587+0000 7f71a2000700 1 --2- 172.21.15.5:0/1419247983 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f7184038300 0x7f718403a7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-24T15:33:35.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.664+0000 7f71a9800700 1 -- 172.21.15.5:0/1419247983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f71a41a0130 con 0x7f71a4106630 2024-01-24T15:33:35.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.664+0000 7f719b400700 1 -- 172.21.15.5:0/1419247983 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f719401f020 con 0x7f71a4106630 2024-01-24T15:33:35.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.667+0000 7f71a9800700 1 -- 172.21.15.5:0/1419247983 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f7184038300 msgr2=0x7f718403a7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-24T15:33:35.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.667+0000 7f71a9800700 1 --2- 172.21.15.5:0/1419247983 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f7184038300 0x7f718403a7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:35.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.667+0000 7f71a9800700 1 -- 172.21.15.5:0/1419247983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71a4106630 msgr2=0x7f71a419c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:35.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.667+0000 7f71a9800700 1 --2- 172.21.15.5:0/1419247983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71a4106630 0x7f71a419c450 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7194000c00 tx=0x7f7194011e70 comp rx=0 tx=0).stop 2024-01-24T15:33:35.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.667+0000 7f71a9800700 1 -- 172.21.15.5:0/1419247983 shutdown_connections 2024-01-24T15:33:35.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.667+0000 7f71a9800700 1 --2- 172.21.15.5:0/1419247983 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f7184038300 0x7f718403a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:35.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.667+0000 7f71a9800700 1 --2- 172.21.15.5:0/1419247983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f71a4106630 0x7f71a419c450 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:35.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.667+0000 7f71a9800700 1 -- 172.21.15.5:0/1419247983 >> 172.21.15.5:0/1419247983 conn(0x7f71a4101c30 msgr2=0x7f71a41029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:35.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.667+0000 7f71a9800700 1 -- 172.21.15.5:0/1419247983 shutdown_connections 2024-01-24T15:33:35.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:35.667+0000 7f71a9800700 1 -- 172.21.15.5:0/1419247983 wait complete. 2024-01-24T15:33:35.996 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for the mgr to restart... 2024-01-24T15:33:35.996 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr epoch 5... 2024-01-24T15:33:36.875 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:36 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:36.571+0000 7f3dfd5ee200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-24T15:33:36.875 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:36 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:36.873+0000 7f3dfd5ee200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-24T15:33:37.130 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:36 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:36.987+0000 7f3dfd5ee200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-24T15:33:37.131 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:37 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:37.129+0000 7f3dfd5ee200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-24T15:33:37.432 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:37 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:37.329+0000 7f3dfd5ee200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-24T15:33:37.932 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:37 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:37.503+0000 7f3dfd5ee200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-24T15:33:37.933 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:37 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:37.618+0000 7f3dfd5ee200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-24T15:33:38.432 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:38 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:38.094+0000 7f3dfd5ee200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-24T15:33:38.810 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:38 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:38.447+0000 7f3dfd5ee200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-24T15:33:39.182 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:38 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:38.808+0000 7f3dfd5ee200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-24T15:33:39.183 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:38 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:38.934+0000 7f3dfd5ee200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-24T15:33:40.182 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:39 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:39.908+0000 7f3dfd5ee200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-24T15:33:40.183 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:40 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:40.035+0000 7f3dfd5ee200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-24T15:33:40.682 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:40 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:40.232+0000 7f3dfd5ee200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-24T15:33:41.432 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:41 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:41.062+0000 7f3dfd5ee200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-24T15:33:41.433 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:41 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:41.306+0000 7f3dfd5ee200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-24T15:33:41.933 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:41 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:41.562+0000 7f3dfd5ee200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-24T15:33:43.072 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:42 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:42.711+0000 7f3dfd5ee200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-24T15:33:43.432 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:43 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:43.071+0000 7f3dfd5ee200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-24T15:33:43.433 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:43 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:43.188+0000 7f3dfd5ee200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-24T15:33:43.932 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:43 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:43.444+0000 7f3dfd5ee200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-24T15:33:43.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:43 smithi005 ceph-mon[35346]: Active manager daemon x restarted 2024-01-24T15:33:43.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:43 smithi005 ceph-mon[35346]: Activating manager daemon x 2024-01-24T15:33:43.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:43 smithi005 ceph-mon[35346]: osdmap e2: 0 total, 0 up, 0 in 2024-01-24T15:33:43.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:43 smithi005 ceph-mon[35346]: mgrmap e6: x(active, starting, since 0.00403466s) 2024-01-24T15:33:43.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:43 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-24T15:33:43.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:43 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-24T15:33:43.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:43 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-24T15:33:43.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:43 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-24T15:33:43.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:43 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-24T15:33:43.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:43 smithi005 ceph-mon[35346]: Manager daemon x is now available 2024-01-24T15:33:43.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:43 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' 2024-01-24T15:33:43.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:43 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' 2024-01-24T15:33:43.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:43 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:33:43.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:43 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:33:44.789 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-01-24T15:33:44.789 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-01-24T15:33:44.789 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "initialized": true 2024-01-24T15:33:44.790 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-01-24T15:33:44.790 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.397+0000 7f4857000700 1 Processor -- start 2024-01-24T15:33:44.790 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.398+0000 7f4857000700 1 -- start start 2024-01-24T15:33:44.790 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.398+0000 7f4857000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f485007ad60 0x7f48500791c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:44.790 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.398+0000 7f4857000700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4850079790 con 0x7f485007ad60 2024-01-24T15:33:44.790 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.398+0000 7f484fe00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f485007ad60 0x7f48500791c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:44.790 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:44 smithi005 ceph-mon[35346]: Found migration_current of "None". Setting to last migration. 2024-01-24T15:33:44.790 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:44 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:33:44.790 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:44 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-24T15:33:44.790 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:44 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-24T15:33:44.791 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:44 smithi005 ceph-mon[35346]: mgrmap e7: x(active, since 1.00689s) 2024-01-24T15:33:44.797 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.398+0000 7f484fe00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f485007ad60 0x7f48500791c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56288/0 (socket says 172.21.15.5:56288) 2024-01-24T15:33:44.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.398+0000 7f484fe00700 1 -- 172.21.15.5:0/427655103 learned_addr learned my addr 172.21.15.5:0/427655103 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:44.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.399+0000 7f484fe00700 1 -- 172.21.15.5:0/427655103 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48500798d0 con 0x7f485007ad60 2024-01-24T15:33:44.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.399+0000 7f484fe00700 1 --2- 172.21.15.5:0/427655103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f485007ad60 0x7f48500791c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f48400098a0 tx=0x7f4840009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736f9289763e76e6 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:44.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.399+0000 7f484ea00700 1 -- 172.21.15.5:0/427655103 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4840004160 con 0x7f485007ad60 2024-01-24T15:33:44.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.399+0000 7f484ea00700 1 -- 172.21.15.5:0/427655103 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f48400042c0 con 0x7f485007ad60 2024-01-24T15:33:44.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.399+0000 7f484ea00700 1 -- 172.21.15.5:0/427655103 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4840011940 con 0x7f485007ad60 2024-01-24T15:33:44.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.400+0000 7f4857000700 1 -- 172.21.15.5:0/427655103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f485007ad60 msgr2=0x7f48500791c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:44.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.400+0000 7f4857000700 1 --2- 172.21.15.5:0/427655103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f485007ad60 0x7f48500791c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f48400098a0 tx=0x7f4840009bb0 comp rx=0 tx=0).stop 2024-01-24T15:33:44.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.400+0000 7f4857000700 1 -- 172.21.15.5:0/427655103 shutdown_connections 2024-01-24T15:33:44.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.400+0000 7f4857000700 1 --2- 172.21.15.5:0/427655103 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f485007ad60 0x7f48500791c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:44.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.400+0000 7f4857000700 1 -- 172.21.15.5:0/427655103 >> 172.21.15.5:0/427655103 conn(0x7f4850101c00 msgr2=0x7f4850104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:44.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.400+0000 7f4857000700 1 -- 172.21.15.5:0/427655103 shutdown_connections 2024-01-24T15:33:44.798 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.400+0000 7f4857000700 1 -- 172.21.15.5:0/427655103 wait complete. 2024-01-24T15:33:44.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.402+0000 7f4857000700 1 Processor -- start 2024-01-24T15:33:44.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.402+0000 7f4857000700 1 -- start start 2024-01-24T15:33:44.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.402+0000 7f4857000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f485007ad60 0x7f485019c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:44.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.402+0000 7f4857000700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485019c940 con 0x7f485007ad60 2024-01-24T15:33:44.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.403+0000 7f484fe00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f485007ad60 0x7f485019c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:44.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.403+0000 7f484fe00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f485007ad60 0x7f485019c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:56290/0 (socket says 172.21.15.5:56290) 2024-01-24T15:33:44.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.403+0000 7f484fe00700 1 -- 172.21.15.5:0/2817907893 learned_addr learned my addr 172.21.15.5:0/2817907893 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:44.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.403+0000 7f484fe00700 1 -- 172.21.15.5:0/2817907893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4840009550 con 0x7f485007ad60 2024-01-24T15:33:44.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.403+0000 7f484fe00700 1 --2- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f485007ad60 0x7f485019c400 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4840011dc0 tx=0x7f4840011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:44.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.403+0000 7f484cc00700 1 -- 172.21.15.5:0/2817907893 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48400037d0 con 0x7f485007ad60 2024-01-24T15:33:44.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.404+0000 7f484cc00700 1 -- 172.21.15.5:0/2817907893 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f484001b440 con 0x7f485007ad60 2024-01-24T15:33:44.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.404+0000 7f4857000700 1 -- 172.21.15.5:0/2817907893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f485019cb40 con 0x7f485007ad60 2024-01-24T15:33:44.799 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.404+0000 7f484cc00700 1 -- 172.21.15.5:0/2817907893 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f484001a560 con 0x7f485007ad60 2024-01-24T15:33:44.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.404+0000 7f4857000700 1 -- 172.21.15.5:0/2817907893 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485019cf60 con 0x7f485007ad60 2024-01-24T15:33:44.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.405+0000 7f484cc00700 1 -- 172.21.15.5:0/2817907893 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 5) v1 ==== 45268+0+0 (secure 0 0 0) 0x7f484001b5b0 con 0x7f485007ad60 2024-01-24T15:33:44.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.405+0000 7f484cc00700 1 --2- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f4830038300 0x7f483003a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:44.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.405+0000 7f484cc00700 1 -- 172.21.15.5:0/2817907893 --> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f483003aed0 con 0x7f4830038300 2024-01-24T15:33:44.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.405+0000 7f484cc00700 1 -- 172.21.15.5:0/2817907893 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f484004c050 con 0x7f485007ad60 2024-01-24T15:33:44.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.405+0000 7f484f400700 1 -- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f4830038300 msgr2=0x7f483003a7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1174207089 2024-01-24T15:33:44.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.405+0000 7f484f400700 1 --2- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f4830038300 0x7f483003a7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-24T15:33:44.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.606+0000 7f484f400700 1 -- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f4830038300 msgr2=0x7f483003a7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1174207089 2024-01-24T15:33:44.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:36.606+0000 7f484f400700 1 --2- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f4830038300 0x7f483003a7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-24T15:33:44.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:37.007+0000 7f484f400700 1 -- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f4830038300 msgr2=0x7f483003a7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1174207089 2024-01-24T15:33:44.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:37.007+0000 7f484f400700 1 --2- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f4830038300 0x7f483003a7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-24T15:33:44.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:37.808+0000 7f484f400700 1 -- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f4830038300 msgr2=0x7f483003a7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1174207089 2024-01-24T15:33:44.800 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:37.808+0000 7f484f400700 1 --2- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f4830038300 0x7f483003a7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-24T15:33:44.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:39.410+0000 7f484f400700 1 -- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f4830038300 msgr2=0x7f483003a7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1174207089 2024-01-24T15:33:44.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:39.410+0000 7f484f400700 1 --2- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f4830038300 0x7f483003a7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-01-24T15:33:44.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:42.613+0000 7f484f400700 1 -- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f4830038300 msgr2=0x7f483003a7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/1174207089 2024-01-24T15:33:44.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:42.613+0000 7f484f400700 1 --2- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f4830038300 0x7f483003a7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-01-24T15:33:44.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:43.449+0000 7f484cc00700 1 -- 172.21.15.5:0/2817907893 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mgrmap(e 6) v1 ==== 45035+0+0 (secure 0 0 0) 0x7f4840020d40 con 0x7f485007ad60 2024-01-24T15:33:44.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:43.449+0000 7f484cc00700 1 -- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f4830038300 msgr2=0x7f483003a7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-24T15:33:44.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:43.449+0000 7f484cc00700 1 --2- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f4830038300 0x7f483003a7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:44.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:44.451+0000 7f484cc00700 1 -- 172.21.15.5:0/2817907893 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 7) v1 ==== 45162+0+0 (secure 0 0 0) 0x7f4840021da0 con 0x7f485007ad60 2024-01-24T15:33:44.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:44.451+0000 7f484cc00700 1 --2- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f483003bbe0 0x7f483003dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:44.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:44.451+0000 7f484cc00700 1 -- 172.21.15.5:0/2817907893 --> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f483003aed0 con 0x7f483003bbe0 2024-01-24T15:33:44.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:44.452+0000 7f484f400700 1 --2- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f483003bbe0 0x7f483003dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:44.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:44.453+0000 7f484f400700 1 --2- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f483003bbe0 0x7f483003dfd0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4838003a10 tx=0x7f4838009290 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:44.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:44.454+0000 7f484cc00700 1 -- 172.21.15.5:0/2817907893 <== mgr.14118 v2:172.21.15.5:6800/2286807214 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f483003aed0 con 0x7f483003bbe0 2024-01-24T15:33:44.801 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:44.460+0000 7f4857000700 1 -- 172.21.15.5:0/2817907893 --> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f485019d740 con 0x7f483003bbe0 2024-01-24T15:33:44.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:44.461+0000 7f484cc00700 1 -- 172.21.15.5:0/2817907893 <== mgr.14118 v2:172.21.15.5:6800/2286807214 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f485019d740 con 0x7f483003bbe0 2024-01-24T15:33:44.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:44.461+0000 7f4857000700 1 -- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f483003bbe0 msgr2=0x7f483003dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:44.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:44.461+0000 7f4857000700 1 --2- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f483003bbe0 0x7f483003dfd0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4838003a10 tx=0x7f4838009290 comp rx=0 tx=0).stop 2024-01-24T15:33:44.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:44.461+0000 7f4857000700 1 -- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f485007ad60 msgr2=0x7f485019c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:44.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:44.461+0000 7f4857000700 1 --2- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f485007ad60 0x7f485019c400 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4840011dc0 tx=0x7f4840011ea0 comp rx=0 tx=0).stop 2024-01-24T15:33:44.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:44.461+0000 7f4857000700 1 -- 172.21.15.5:0/2817907893 shutdown_connections 2024-01-24T15:33:44.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:44.461+0000 7f4857000700 1 --2- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f483003bbe0 0x7f483003dfd0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:44.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:44.461+0000 7f4857000700 1 --2- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f485007ad60 0x7f485019c400 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:44.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:44.461+0000 7f4857000700 1 --2- 172.21.15.5:0/2817907893 >> [v2:172.21.15.5:6800/1174207089,v1:172.21.15.5:6801/1174207089] conn(0x7f4830038300 0x7f483003a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:44.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:44.461+0000 7f4857000700 1 -- 172.21.15.5:0/2817907893 >> 172.21.15.5:0/2817907893 conn(0x7f4850101c00 msgr2=0x7f4850102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:44.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:44.461+0000 7f4857000700 1 -- 172.21.15.5:0/2817907893 shutdown_connections 2024-01-24T15:33:44.802 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:44.461+0000 7f4857000700 1 -- 172.21.15.5:0/2817907893 wait complete. 2024-01-24T15:33:44.802 INFO:teuthology.orchestra.run.smithi005.stdout:mgr epoch 5 is available 2024-01-24T15:33:44.802 INFO:teuthology.orchestra.run.smithi005.stdout:Setting orchestrator backend to cephadm... 2024-01-24T15:33:45.737 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:45 smithi005 ceph-mon[35346]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-01-24T15:33:45.737 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:45 smithi005 ceph-mon[35346]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-01-24T15:33:45.737 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:45 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' 2024-01-24T15:33:45.738 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:45 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' 2024-01-24T15:33:45.738 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:45 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:33:45.738 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:45 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' 2024-01-24T15:33:45.738 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:45 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:33:45.743 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.178+0000 7fe8e8e00700 1 Processor -- start 2024-01-24T15:33:45.743 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.178+0000 7fe8e8e00700 1 -- start start 2024-01-24T15:33:45.743 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.178+0000 7fe8e8e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e407ad40 0x7fe8e40791a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:45.743 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.178+0000 7fe8e8e00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e4079770 con 0x7fe8e407ad40 2024-01-24T15:33:45.743 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.178+0000 7fe8e1e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e407ad40 0x7fe8e40791a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:45.743 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.178+0000 7fe8e1e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e407ad40 0x7fe8e40791a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60626/0 (socket says 172.21.15.5:60626) 2024-01-24T15:33:45.743 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.178+0000 7fe8e1e00700 1 -- 172.21.15.5:0/15969482 learned_addr learned my addr 172.21.15.5:0/15969482 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.179+0000 7fe8e1e00700 1 -- 172.21.15.5:0/15969482 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e40798b0 con 0x7fe8e407ad40 2024-01-24T15:33:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.179+0000 7fe8e1e00700 1 --2- 172.21.15.5:0/15969482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e407ad40 0x7fe8e40791a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40098a0 tx=0x7fe8d4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8beed4efad7d56 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.179+0000 7fe8e0a00700 1 -- 172.21.15.5:0/15969482 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8d4004160 con 0x7fe8e407ad40 2024-01-24T15:33:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.179+0000 7fe8e0a00700 1 -- 172.21.15.5:0/15969482 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fe8d40042c0 con 0x7fe8e407ad40 2024-01-24T15:33:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.179+0000 7fe8e0a00700 1 -- 172.21.15.5:0/15969482 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8d4011940 con 0x7fe8e407ad40 2024-01-24T15:33:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.180+0000 7fe8e8e00700 1 -- 172.21.15.5:0/15969482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e407ad40 msgr2=0x7fe8e40791a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.180+0000 7fe8e8e00700 1 --2- 172.21.15.5:0/15969482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e407ad40 0x7fe8e40791a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40098a0 tx=0x7fe8d4009bb0 comp rx=0 tx=0).stop 2024-01-24T15:33:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.180+0000 7fe8e8e00700 1 -- 172.21.15.5:0/15969482 shutdown_connections 2024-01-24T15:33:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.180+0000 7fe8e8e00700 1 --2- 172.21.15.5:0/15969482 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e407ad40 0x7fe8e40791a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.180+0000 7fe8e8e00700 1 -- 172.21.15.5:0/15969482 >> 172.21.15.5:0/15969482 conn(0x7fe8e4101c00 msgr2=0x7fe8e4104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.180+0000 7fe8e8e00700 1 -- 172.21.15.5:0/15969482 shutdown_connections 2024-01-24T15:33:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.180+0000 7fe8e8e00700 1 -- 172.21.15.5:0/15969482 wait complete. 2024-01-24T15:33:45.744 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.181+0000 7fe8e8e00700 1 Processor -- start 2024-01-24T15:33:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.181+0000 7fe8e8e00700 1 -- start start 2024-01-24T15:33:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.181+0000 7fe8e8e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e407ad40 0x7fe8e419c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.182+0000 7fe8e8e00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e419c940 con 0x7fe8e407ad40 2024-01-24T15:33:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.182+0000 7fe8e1e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e407ad40 0x7fe8e419c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.182+0000 7fe8e1e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e407ad40 0x7fe8e419c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60632/0 (socket says 172.21.15.5:60632) 2024-01-24T15:33:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.182+0000 7fe8e1e00700 1 -- 172.21.15.5:0/3798959994 learned_addr learned my addr 172.21.15.5:0/3798959994 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.182+0000 7fe8e1e00700 1 -- 172.21.15.5:0/3798959994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d4009550 con 0x7fe8e407ad40 2024-01-24T15:33:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.182+0000 7fe8e1e00700 1 --2- 172.21.15.5:0/3798959994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e407ad40 0x7fe8e419c400 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4011dc0 tx=0x7fe8d4011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.183+0000 7fe8daa00700 1 -- 172.21.15.5:0/3798959994 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8d40037d0 con 0x7fe8e407ad40 2024-01-24T15:33:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.183+0000 7fe8daa00700 1 -- 172.21.15.5:0/3798959994 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fe8d401b440 con 0x7fe8e407ad40 2024-01-24T15:33:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.183+0000 7fe8daa00700 1 -- 172.21.15.5:0/3798959994 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8d401a560 con 0x7fe8e407ad40 2024-01-24T15:33:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.183+0000 7fe8e8e00700 1 -- 172.21.15.5:0/3798959994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e419cb40 con 0x7fe8e407ad40 2024-01-24T15:33:45.745 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.183+0000 7fe8e8e00700 1 -- 172.21.15.5:0/3798959994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e419cf60 con 0x7fe8e407ad40 2024-01-24T15:33:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.184+0000 7fe8daa00700 1 -- 172.21.15.5:0/3798959994 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 7) v1 ==== 45162+0+0 (secure 0 0 0) 0x7fe8d401b5b0 con 0x7fe8e407ad40 2024-01-24T15:33:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.184+0000 7fe8e8e00700 1 -- 172.21.15.5:0/3798959994 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e4062370 con 0x7fe8e407ad40 2024-01-24T15:33:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.184+0000 7fe8daa00700 1 --2- 172.21.15.5:0/3798959994 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fe8c4038220 0x7fe8c403a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.184+0000 7fe8daa00700 1 -- 172.21.15.5:0/3798959994 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe8d404bf50 con 0x7fe8e407ad40 2024-01-24T15:33:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.185+0000 7fe8e1400700 1 --2- 172.21.15.5:0/3798959994 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fe8c4038220 0x7fe8c403a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.185+0000 7fe8e1400700 1 --2- 172.21.15.5:0/3798959994 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fe8c4038220 0x7fe8c403a6e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc006fd0 tx=0x7fe8cc006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.190+0000 7fe8daa00700 1 -- 172.21.15.5:0/3798959994 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7fe8d4023590 con 0x7fe8e407ad40 2024-01-24T15:33:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.415+0000 7fe8e8e00700 1 -- 172.21.15.5:0/3798959994 --> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8e4103070 con 0x7fe8c4038220 2024-01-24T15:33:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.422+0000 7fe8daa00700 1 -- 172.21.15.5:0/3798959994 <== mgr.14118 v2:172.21.15.5:6800/2286807214 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe8e4103070 con 0x7fe8c4038220 2024-01-24T15:33:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.424+0000 7fe8e8e00700 1 -- 172.21.15.5:0/3798959994 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fe8c4038220 msgr2=0x7fe8c403a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.424+0000 7fe8e8e00700 1 --2- 172.21.15.5:0/3798959994 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fe8c4038220 0x7fe8c403a6e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc006fd0 tx=0x7fe8cc006e40 comp rx=0 tx=0).stop 2024-01-24T15:33:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.424+0000 7fe8e8e00700 1 -- 172.21.15.5:0/3798959994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e407ad40 msgr2=0x7fe8e419c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.424+0000 7fe8e8e00700 1 --2- 172.21.15.5:0/3798959994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e407ad40 0x7fe8e419c400 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4011dc0 tx=0x7fe8d4011ea0 comp rx=0 tx=0).stop 2024-01-24T15:33:45.746 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.424+0000 7fe8e8e00700 1 -- 172.21.15.5:0/3798959994 shutdown_connections 2024-01-24T15:33:45.747 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.424+0000 7fe8e8e00700 1 --2- 172.21.15.5:0/3798959994 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fe8c4038220 0x7fe8c403a6e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:45.747 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.424+0000 7fe8e8e00700 1 --2- 172.21.15.5:0/3798959994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe8e407ad40 0x7fe8e419c400 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:45.747 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.424+0000 7fe8e8e00700 1 -- 172.21.15.5:0/3798959994 >> 172.21.15.5:0/3798959994 conn(0x7fe8e4101c00 msgr2=0x7fe8e4102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:45.747 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.425+0000 7fe8e8e00700 1 -- 172.21.15.5:0/3798959994 shutdown_connections 2024-01-24T15:33:45.747 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:45.425+0000 7fe8e8e00700 1 -- 172.21.15.5:0/3798959994 wait complete. 2024-01-24T15:33:46.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:46 smithi005 ceph-mon[35346]: [24/Jan/2024:15:33:44] ENGINE Bus STARTING 2024-01-24T15:33:46.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:46 smithi005 ceph-mon[35346]: [24/Jan/2024:15:33:44] ENGINE Serving on http://172.21.15.5:8765 2024-01-24T15:33:46.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:46 smithi005 ceph-mon[35346]: [24/Jan/2024:15:33:45] ENGINE Serving on https://172.21.15.5:7150 2024-01-24T15:33:46.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:46 smithi005 ceph-mon[35346]: [24/Jan/2024:15:33:45] ENGINE Bus STARTED 2024-01-24T15:33:46.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:46 smithi005 ceph-mon[35346]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:33:46.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:46 smithi005 ceph-mon[35346]: mgrmap e8: x(active, since 2s) 2024-01-24T15:33:46.695 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout value unchanged 2024-01-24T15:33:46.695 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.117+0000 7f80ed000700 1 Processor -- start 2024-01-24T15:33:46.695 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.117+0000 7f80ed000700 1 -- start start 2024-01-24T15:33:46.695 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.117+0000 7f80ed000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8105520 0x7f80e8105940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:46.695 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.117+0000 7f80ed000700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e8105f10 con 0x7f80e8105520 2024-01-24T15:33:46.695 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.118+0000 7f80e5e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8105520 0x7f80e8105940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:46.695 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.118+0000 7f80e5e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8105520 0x7f80e8105940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60648/0 (socket says 172.21.15.5:60648) 2024-01-24T15:33:46.696 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.118+0000 7f80e5e00700 1 -- 172.21.15.5:0/2288053034 learned_addr learned my addr 172.21.15.5:0/2288053034 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:46.696 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.118+0000 7f80e5e00700 1 -- 172.21.15.5:0/2288053034 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e8106720 con 0x7f80e8105520 2024-01-24T15:33:46.696 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.118+0000 7f80e5e00700 1 --2- 172.21.15.5:0/2288053034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8105520 0x7f80e8105940 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f80d80098a0 tx=0x7f80d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0934c030a7cd7f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:46.696 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.119+0000 7f80e4a00700 1 -- 172.21.15.5:0/2288053034 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80d8004160 con 0x7f80e8105520 2024-01-24T15:33:46.696 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.119+0000 7f80e4a00700 1 -- 172.21.15.5:0/2288053034 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f80d80042c0 con 0x7f80e8105520 2024-01-24T15:33:46.696 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.119+0000 7f80e4a00700 1 -- 172.21.15.5:0/2288053034 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80d8011940 con 0x7f80e8105520 2024-01-24T15:33:46.696 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.119+0000 7f80ed000700 1 -- 172.21.15.5:0/2288053034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8105520 msgr2=0x7f80e8105940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:46.696 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.119+0000 7f80ed000700 1 --2- 172.21.15.5:0/2288053034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8105520 0x7f80e8105940 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f80d80098a0 tx=0x7f80d8009bb0 comp rx=0 tx=0).stop 2024-01-24T15:33:46.696 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.119+0000 7f80ed000700 1 -- 172.21.15.5:0/2288053034 shutdown_connections 2024-01-24T15:33:46.696 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.119+0000 7f80ed000700 1 --2- 172.21.15.5:0/2288053034 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8105520 0x7f80e8105940 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:46.696 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.119+0000 7f80ed000700 1 -- 172.21.15.5:0/2288053034 >> 172.21.15.5:0/2288053034 conn(0x7f80e8100b20 msgr2=0x7f80e8102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:46.696 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.119+0000 7f80ed000700 1 -- 172.21.15.5:0/2288053034 shutdown_connections 2024-01-24T15:33:46.696 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.119+0000 7f80ed000700 1 -- 172.21.15.5:0/2288053034 wait complete. 2024-01-24T15:33:46.697 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.121+0000 7f80ed000700 1 Processor -- start 2024-01-24T15:33:46.697 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.121+0000 7f80ed000700 1 -- start start 2024-01-24T15:33:46.697 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.121+0000 7f80ed000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8105520 0x7f80e819c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:46.697 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.121+0000 7f80ed000700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e819c950 con 0x7f80e8105520 2024-01-24T15:33:46.697 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.121+0000 7f80e5e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8105520 0x7f80e819c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:46.697 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.121+0000 7f80e5e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8105520 0x7f80e819c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60658/0 (socket says 172.21.15.5:60658) 2024-01-24T15:33:46.697 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.121+0000 7f80e5e00700 1 -- 172.21.15.5:0/3576969156 learned_addr learned my addr 172.21.15.5:0/3576969156 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:46.697 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.122+0000 7f80e5e00700 1 -- 172.21.15.5:0/3576969156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d8009550 con 0x7f80e8105520 2024-01-24T15:33:46.697 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.122+0000 7f80e5e00700 1 --2- 172.21.15.5:0/3576969156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8105520 0x7f80e819c410 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f80d8000c00 tx=0x7f80d8011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:46.697 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.122+0000 7f80dea00700 1 -- 172.21.15.5:0/3576969156 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80d80036a0 con 0x7f80e8105520 2024-01-24T15:33:46.697 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.122+0000 7f80dea00700 1 -- 172.21.15.5:0/3576969156 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f80d801b440 con 0x7f80e8105520 2024-01-24T15:33:46.697 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.122+0000 7f80dea00700 1 -- 172.21.15.5:0/3576969156 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80d80193f0 con 0x7f80e8105520 2024-01-24T15:33:46.697 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.122+0000 7f80ed000700 1 -- 172.21.15.5:0/3576969156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e819cb50 con 0x7f80e8105520 2024-01-24T15:33:46.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.122+0000 7f80ed000700 1 -- 172.21.15.5:0/3576969156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e819cf70 con 0x7f80e8105520 2024-01-24T15:33:46.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.123+0000 7f80dea00700 1 -- 172.21.15.5:0/3576969156 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 7) v1 ==== 45162+0+0 (secure 0 0 0) 0x7f80d801b5b0 con 0x7f80e8105520 2024-01-24T15:33:46.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.123+0000 7f80ed000700 1 -- 172.21.15.5:0/3576969156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e8062370 con 0x7f80e8105520 2024-01-24T15:33:46.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.124+0000 7f80dea00700 1 --2- 172.21.15.5:0/3576969156 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f80c8038220 0x7f80c803a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:46.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.124+0000 7f80dea00700 1 -- 172.21.15.5:0/3576969156 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f80d804bec0 con 0x7f80e8105520 2024-01-24T15:33:46.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.124+0000 7f80e5400700 1 --2- 172.21.15.5:0/3576969156 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f80c8038220 0x7f80c803a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:46.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.125+0000 7f80e5400700 1 --2- 172.21.15.5:0/3576969156 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f80c8038220 0x7f80c803a6e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f80d0006fd0 tx=0x7f80d0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:46.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.129+0000 7f80dea00700 1 -- 172.21.15.5:0/3576969156 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f80d8022950 con 0x7f80e8105520 2024-01-24T15:33:46.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.336+0000 7f80ed000700 1 -- 172.21.15.5:0/3576969156 --> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f80e8102c60 con 0x7f80c8038220 2024-01-24T15:33:46.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.337+0000 7f80dea00700 1 -- 172.21.15.5:0/3576969156 <== mgr.14118 v2:172.21.15.5:6800/2286807214 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f80e8102c60 con 0x7f80c8038220 2024-01-24T15:33:46.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.339+0000 7f80ed000700 1 -- 172.21.15.5:0/3576969156 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f80c8038220 msgr2=0x7f80c803a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:46.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.339+0000 7f80ed000700 1 --2- 172.21.15.5:0/3576969156 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f80c8038220 0x7f80c803a6e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f80d0006fd0 tx=0x7f80d0006e40 comp rx=0 tx=0).stop 2024-01-24T15:33:46.698 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.339+0000 7f80ed000700 1 -- 172.21.15.5:0/3576969156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8105520 msgr2=0x7f80e819c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:46.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.339+0000 7f80ed000700 1 --2- 172.21.15.5:0/3576969156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8105520 0x7f80e819c410 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f80d8000c00 tx=0x7f80d8011e70 comp rx=0 tx=0).stop 2024-01-24T15:33:46.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.340+0000 7f80ed000700 1 -- 172.21.15.5:0/3576969156 shutdown_connections 2024-01-24T15:33:46.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.340+0000 7f80ed000700 1 --2- 172.21.15.5:0/3576969156 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f80c8038220 0x7f80c803a6e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:46.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.340+0000 7f80ed000700 1 --2- 172.21.15.5:0/3576969156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e8105520 0x7f80e819c410 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:46.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.340+0000 7f80ed000700 1 -- 172.21.15.5:0/3576969156 >> 172.21.15.5:0/3576969156 conn(0x7f80e8100b20 msgr2=0x7f80e8073f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:46.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.340+0000 7f80ed000700 1 -- 172.21.15.5:0/3576969156 shutdown_connections 2024-01-24T15:33:46.699 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:46.340+0000 7f80ed000700 1 -- 172.21.15.5:0/3576969156 wait complete. 2024-01-24T15:33:46.699 INFO:teuthology.orchestra.run.smithi005.stdout:Generating ssh key... 2024-01-24T15:33:47.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:47 smithi005 ceph-mon[35346]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:33:47.933 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:47 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: Generating public/private rsa key pair. 2024-01-24T15:33:47.933 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:47 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: Your identification has been saved in /tmp/tmp2ey1ta1f/key. 2024-01-24T15:33:47.934 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:47 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: Your public key has been saved in /tmp/tmp2ey1ta1f/key.pub. 2024-01-24T15:33:47.934 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:47 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: The key fingerprint is: 2024-01-24T15:33:47.934 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:47 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: SHA256:NGsmdpMXVe+54woU82tDYVqZZlzvwl0Qna+VcTidPTE ceph-bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:33:47.934 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:47 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: The key's randomart image is: 2024-01-24T15:33:47.934 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:47 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: +---[RSA 3072]----+ 2024-01-24T15:33:47.934 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:47 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: | ..+E=| 2024-01-24T15:33:47.934 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:47 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: | .. *BB| 2024-01-24T15:33:47.934 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:47 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: | o .o X .X| 2024-01-24T15:33:47.934 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:47 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: | . + .X..==| 2024-01-24T15:33:47.934 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:47 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: | o S .o oo++| 2024-01-24T15:33:47.935 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:47 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: | . = o. . o..| 2024-01-24T15:33:47.935 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:47 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: | . + o | 2024-01-24T15:33:47.935 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:47 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: | o o .| 2024-01-24T15:33:47.935 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:47 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: | ... | 2024-01-24T15:33:47.935 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:47 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: +----[SHA256]-----+ 2024-01-24T15:33:47.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.074+0000 7fd52ea00700 1 Processor -- start 2024-01-24T15:33:47.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.074+0000 7fd52ea00700 1 -- start start 2024-01-24T15:33:47.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.075+0000 7fd52ea00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd528106620 0x7fd528106a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:47.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.075+0000 7fd52ea00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd528107010 con 0x7fd528106620 2024-01-24T15:33:47.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.075+0000 7fd527e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd528106620 0x7fd528106a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:47.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.075+0000 7fd527e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd528106620 0x7fd528106a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60662/0 (socket says 172.21.15.5:60662) 2024-01-24T15:33:47.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.075+0000 7fd527e00700 1 -- 172.21.15.5:0/786653366 learned_addr learned my addr 172.21.15.5:0/786653366 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:47.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.075+0000 7fd527e00700 1 -- 172.21.15.5:0/786653366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd528107820 con 0x7fd528106620 2024-01-24T15:33:47.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.076+0000 7fd527e00700 1 --2- 172.21.15.5:0/786653366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd528106620 0x7fd528106a40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd5180098a0 tx=0x7fd518009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5758c270ab2967dc server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:47.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.076+0000 7fd526a00700 1 -- 172.21.15.5:0/786653366 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd518004160 con 0x7fd528106620 2024-01-24T15:33:47.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.076+0000 7fd526a00700 1 -- 172.21.15.5:0/786653366 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fd5180042c0 con 0x7fd528106620 2024-01-24T15:33:47.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.076+0000 7fd526a00700 1 -- 172.21.15.5:0/786653366 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd518011940 con 0x7fd528106620 2024-01-24T15:33:47.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.076+0000 7fd52ea00700 1 -- 172.21.15.5:0/786653366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd528106620 msgr2=0x7fd528106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:47.979 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.076+0000 7fd52ea00700 1 --2- 172.21.15.5:0/786653366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd528106620 0x7fd528106a40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd5180098a0 tx=0x7fd518009bb0 comp rx=0 tx=0).stop 2024-01-24T15:33:47.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.077+0000 7fd52ea00700 1 -- 172.21.15.5:0/786653366 shutdown_connections 2024-01-24T15:33:47.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.077+0000 7fd52ea00700 1 --2- 172.21.15.5:0/786653366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd528106620 0x7fd528106a40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:47.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.077+0000 7fd52ea00700 1 -- 172.21.15.5:0/786653366 >> 172.21.15.5:0/786653366 conn(0x7fd528101c00 msgr2=0x7fd528104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:47.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.077+0000 7fd52ea00700 1 -- 172.21.15.5:0/786653366 shutdown_connections 2024-01-24T15:33:47.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.077+0000 7fd52ea00700 1 -- 172.21.15.5:0/786653366 wait complete. 2024-01-24T15:33:47.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.078+0000 7fd52ea00700 1 Processor -- start 2024-01-24T15:33:47.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.078+0000 7fd52ea00700 1 -- start start 2024-01-24T15:33:47.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.078+0000 7fd52ea00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd528106620 0x7fd52819c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:47.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.078+0000 7fd52ea00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52819c930 con 0x7fd528106620 2024-01-24T15:33:47.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.078+0000 7fd527e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd528106620 0x7fd52819c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:47.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.078+0000 7fd527e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd528106620 0x7fd52819c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60674/0 (socket says 172.21.15.5:60674) 2024-01-24T15:33:47.980 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.078+0000 7fd527e00700 1 -- 172.21.15.5:0/679962217 learned_addr learned my addr 172.21.15.5:0/679962217 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:47.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.079+0000 7fd527e00700 1 -- 172.21.15.5:0/679962217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd518009550 con 0x7fd528106620 2024-01-24T15:33:47.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.079+0000 7fd527e00700 1 --2- 172.21.15.5:0/679962217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd528106620 0x7fd52819c3f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd518000c00 tx=0x7fd518011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:47.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.079+0000 7fd524c00700 1 -- 172.21.15.5:0/679962217 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd5180036a0 con 0x7fd528106620 2024-01-24T15:33:47.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.079+0000 7fd524c00700 1 -- 172.21.15.5:0/679962217 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fd51801b440 con 0x7fd528106620 2024-01-24T15:33:47.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.079+0000 7fd52ea00700 1 -- 172.21.15.5:0/679962217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52819cb30 con 0x7fd528106620 2024-01-24T15:33:47.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.079+0000 7fd524c00700 1 -- 172.21.15.5:0/679962217 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd5180193f0 con 0x7fd528106620 2024-01-24T15:33:47.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.079+0000 7fd52ea00700 1 -- 172.21.15.5:0/679962217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52819cf50 con 0x7fd528106620 2024-01-24T15:33:47.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.080+0000 7fd524c00700 1 -- 172.21.15.5:0/679962217 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 45268+0+0 (secure 0 0 0) 0x7fd51801b5b0 con 0x7fd528106620 2024-01-24T15:33:47.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.080+0000 7fd52ea00700 1 -- 172.21.15.5:0/679962217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd528062370 con 0x7fd528106620 2024-01-24T15:33:47.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.081+0000 7fd524c00700 1 --2- 172.21.15.5:0/679962217 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fd508038350 0x7fd50803a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:47.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.081+0000 7fd524c00700 1 -- 172.21.15.5:0/679962217 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd51804c110 con 0x7fd528106620 2024-01-24T15:33:47.981 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.081+0000 7fd527400700 1 --2- 172.21.15.5:0/679962217 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fd508038350 0x7fd50803a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:47.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.082+0000 7fd527400700 1 --2- 172.21.15.5:0/679962217 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fd508038350 0x7fd50803a810 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd510006fd0 tx=0x7fd510006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:47.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.086+0000 7fd524c00700 1 -- 172.21.15.5:0/679962217 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7fd518022950 con 0x7fd528106620 2024-01-24T15:33:47.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.298+0000 7fd52ea00700 1 -- 172.21.15.5:0/679962217 --> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fd528103030 con 0x7fd508038350 2024-01-24T15:33:47.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.546+0000 7fd524c00700 1 -- 172.21.15.5:0/679962217 <== mgr.14118 v2:172.21.15.5:6800/2286807214 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd528103030 con 0x7fd508038350 2024-01-24T15:33:47.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.549+0000 7fd52ea00700 1 -- 172.21.15.5:0/679962217 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fd508038350 msgr2=0x7fd50803a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:47.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.549+0000 7fd52ea00700 1 --2- 172.21.15.5:0/679962217 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fd508038350 0x7fd50803a810 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd510006fd0 tx=0x7fd510006e40 comp rx=0 tx=0).stop 2024-01-24T15:33:47.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.549+0000 7fd52ea00700 1 -- 172.21.15.5:0/679962217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd528106620 msgr2=0x7fd52819c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:47.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.549+0000 7fd52ea00700 1 --2- 172.21.15.5:0/679962217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd528106620 0x7fd52819c3f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd518000c00 tx=0x7fd518011e70 comp rx=0 tx=0).stop 2024-01-24T15:33:47.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.549+0000 7fd52ea00700 1 -- 172.21.15.5:0/679962217 shutdown_connections 2024-01-24T15:33:47.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.549+0000 7fd52ea00700 1 --2- 172.21.15.5:0/679962217 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fd508038350 0x7fd50803a810 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:47.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.549+0000 7fd52ea00700 1 --2- 172.21.15.5:0/679962217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd528106620 0x7fd52819c3f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:47.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.549+0000 7fd52ea00700 1 -- 172.21.15.5:0/679962217 >> 172.21.15.5:0/679962217 conn(0x7fd528101c00 msgr2=0x7fd528102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:47.982 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.549+0000 7fd52ea00700 1 -- 172.21.15.5:0/679962217 shutdown_connections 2024-01-24T15:33:47.983 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:47.549+0000 7fd52ea00700 1 -- 172.21.15.5:0/679962217 wait complete. 2024-01-24T15:33:48.862 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:48 smithi005 ceph-mon[35346]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:33:48.863 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:48 smithi005 ceph-mon[35346]: Generating ssh key... 2024-01-24T15:33:48.863 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:48 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' 2024-01-24T15:33:48.863 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:48 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' 2024-01-24T15:33:49.006 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCc+OY9hEhcrcd7n+84M2NAt124nQqcFgVvjj5F+CXV2oZeYXx0ZmckT0cKkh6TdewNH4KeLZoypB1CHDkysmQ064K+MQfRHcCcl1mUT8vAtqhmVVb+9nMRJv4crkefUE1os9Af6I6ynndry5ktd+qGQYDPPx0vHt9IcL5vQWBYrhqucEusbS6Vgp+cbTbLPwCzPgh7ALoCFvYeoTZerZfkejqz3F+w+RTR7YzTjr+POHUsJYYfqFkm6wlOFkH8G41lBnicA1989cLQbCGSSvQNSi5lM5wMRYiL9JFR8P8gwElyINMZf1V3yNY4hktO5PMTPL3N82MLa6LFKf/WE/T2QJ7FoBm2nYqppsKUANIc+dWNMmuJJeN1LIvi+6T2JsTBRuIeGPlumxEaMzU2Mbweq/labJW2xBlYCcCvQM0KWMvLDOzNCKEcslh0ZsFE4ZkuJnIYnfpCqrN/BAMHgrhbl03GK4+AmfYYqIXGHcp5gXfM2w/ODL3h5jd0lynLi3M= ceph-bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:33:49.006 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.339+0000 7fa955600700 1 Processor -- start 2024-01-24T15:33:49.006 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.339+0000 7fa955600700 1 -- start start 2024-01-24T15:33:49.006 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.340+0000 7fa955600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95007ad60 0x7fa9500791c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:49.006 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.340+0000 7fa955600700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa950079790 con 0x7fa95007ad60 2024-01-24T15:33:49.006 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.340+0000 7fa94ea00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95007ad60 0x7fa9500791c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:49.006 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.340+0000 7fa94ea00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95007ad60 0x7fa9500791c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60678/0 (socket says 172.21.15.5:60678) 2024-01-24T15:33:49.006 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.340+0000 7fa94ea00700 1 -- 172.21.15.5:0/3629126436 learned_addr learned my addr 172.21.15.5:0/3629126436 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:49.007 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.341+0000 7fa94ea00700 1 -- 172.21.15.5:0/3629126436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9500798d0 con 0x7fa95007ad60 2024-01-24T15:33:49.007 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.341+0000 7fa94ea00700 1 --2- 172.21.15.5:0/3629126436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95007ad60 0x7fa9500791c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa9400098a0 tx=0x7fa940009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32b3b7529ef77ea server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:49.007 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.341+0000 7fa94d600700 1 -- 172.21.15.5:0/3629126436 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa940004160 con 0x7fa95007ad60 2024-01-24T15:33:49.007 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.341+0000 7fa94d600700 1 -- 172.21.15.5:0/3629126436 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fa9400042c0 con 0x7fa95007ad60 2024-01-24T15:33:49.007 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.341+0000 7fa94d600700 1 -- 172.21.15.5:0/3629126436 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa940011940 con 0x7fa95007ad60 2024-01-24T15:33:49.007 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.342+0000 7fa955600700 1 -- 172.21.15.5:0/3629126436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95007ad60 msgr2=0x7fa9500791c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:49.007 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.342+0000 7fa955600700 1 --2- 172.21.15.5:0/3629126436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95007ad60 0x7fa9500791c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa9400098a0 tx=0x7fa940009bb0 comp rx=0 tx=0).stop 2024-01-24T15:33:49.007 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.342+0000 7fa955600700 1 -- 172.21.15.5:0/3629126436 shutdown_connections 2024-01-24T15:33:49.007 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.342+0000 7fa955600700 1 --2- 172.21.15.5:0/3629126436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95007ad60 0x7fa9500791c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:49.007 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.342+0000 7fa955600700 1 -- 172.21.15.5:0/3629126436 >> 172.21.15.5:0/3629126436 conn(0x7fa950101c00 msgr2=0x7fa950104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:49.007 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.342+0000 7fa955600700 1 -- 172.21.15.5:0/3629126436 shutdown_connections 2024-01-24T15:33:49.007 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.342+0000 7fa955600700 1 -- 172.21.15.5:0/3629126436 wait complete. 2024-01-24T15:33:49.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.343+0000 7fa955600700 1 Processor -- start 2024-01-24T15:33:49.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.343+0000 7fa955600700 1 -- start start 2024-01-24T15:33:49.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.343+0000 7fa955600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95007ad60 0x7fa95019c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:49.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.343+0000 7fa955600700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95019c940 con 0x7fa95007ad60 2024-01-24T15:33:49.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.344+0000 7fa94ea00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95007ad60 0x7fa95019c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:49.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.344+0000 7fa94ea00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95007ad60 0x7fa95019c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60688/0 (socket says 172.21.15.5:60688) 2024-01-24T15:33:49.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.344+0000 7fa94ea00700 1 -- 172.21.15.5:0/4065248326 learned_addr learned my addr 172.21.15.5:0/4065248326 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:49.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.344+0000 7fa94ea00700 1 -- 172.21.15.5:0/4065248326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa940009550 con 0x7fa95007ad60 2024-01-24T15:33:49.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.344+0000 7fa94ea00700 1 --2- 172.21.15.5:0/4065248326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95007ad60 0x7fa95019c400 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa940011dc0 tx=0x7fa940011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:49.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.344+0000 7fa947400700 1 -- 172.21.15.5:0/4065248326 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9400037d0 con 0x7fa95007ad60 2024-01-24T15:33:49.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.344+0000 7fa947400700 1 -- 172.21.15.5:0/4065248326 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fa94001b440 con 0x7fa95007ad60 2024-01-24T15:33:49.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.344+0000 7fa955600700 1 -- 172.21.15.5:0/4065248326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa95019cb40 con 0x7fa95007ad60 2024-01-24T15:33:49.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.344+0000 7fa947400700 1 -- 172.21.15.5:0/4065248326 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa94001a560 con 0x7fa95007ad60 2024-01-24T15:33:49.008 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.345+0000 7fa955600700 1 -- 172.21.15.5:0/4065248326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa95019cf60 con 0x7fa95007ad60 2024-01-24T15:33:49.009 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.346+0000 7fa947400700 1 -- 172.21.15.5:0/4065248326 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 45268+0+0 (secure 0 0 0) 0x7fa94001b5b0 con 0x7fa95007ad60 2024-01-24T15:33:49.009 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.346+0000 7fa955600700 1 -- 172.21.15.5:0/4065248326 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa95010c9b0 con 0x7fa95007ad60 2024-01-24T15:33:49.009 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.346+0000 7fa947400700 1 --2- 172.21.15.5:0/4065248326 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fa930038350 0x7fa93003a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:49.009 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.346+0000 7fa947400700 1 -- 172.21.15.5:0/4065248326 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa94004c0a0 con 0x7fa95007ad60 2024-01-24T15:33:49.009 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.346+0000 7fa94e000700 1 --2- 172.21.15.5:0/4065248326 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fa930038350 0x7fa93003a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:49.009 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.347+0000 7fa94e000700 1 --2- 172.21.15.5:0/4065248326 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fa930038350 0x7fa93003a810 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa938006fd0 tx=0x7fa938006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:49.009 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.351+0000 7fa947400700 1 -- 172.21.15.5:0/4065248326 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7fa940023590 con 0x7fa95007ad60 2024-01-24T15:33:49.009 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.560+0000 7fa955600700 1 -- 172.21.15.5:0/4065248326 --> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fa95019fdc0 con 0x7fa930038350 2024-01-24T15:33:49.009 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.560+0000 7fa947400700 1 -- 172.21.15.5:0/4065248326 <== mgr.14118 v2:172.21.15.5:6800/2286807214 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fa95019fdc0 con 0x7fa930038350 2024-01-24T15:33:49.009 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.563+0000 7fa955600700 1 -- 172.21.15.5:0/4065248326 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fa930038350 msgr2=0x7fa93003a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:49.009 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.563+0000 7fa955600700 1 --2- 172.21.15.5:0/4065248326 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fa930038350 0x7fa93003a810 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa938006fd0 tx=0x7fa938006e40 comp rx=0 tx=0).stop 2024-01-24T15:33:49.009 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.563+0000 7fa955600700 1 -- 172.21.15.5:0/4065248326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95007ad60 msgr2=0x7fa95019c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:49.009 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.563+0000 7fa955600700 1 --2- 172.21.15.5:0/4065248326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95007ad60 0x7fa95019c400 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa940011dc0 tx=0x7fa940011ea0 comp rx=0 tx=0).stop 2024-01-24T15:33:49.010 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.563+0000 7fa955600700 1 -- 172.21.15.5:0/4065248326 shutdown_connections 2024-01-24T15:33:49.010 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.563+0000 7fa955600700 1 --2- 172.21.15.5:0/4065248326 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fa930038350 0x7fa93003a810 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:49.010 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.563+0000 7fa955600700 1 --2- 172.21.15.5:0/4065248326 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa95007ad60 0x7fa95019c400 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:49.010 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.563+0000 7fa955600700 1 -- 172.21.15.5:0/4065248326 >> 172.21.15.5:0/4065248326 conn(0x7fa950101c00 msgr2=0x7fa950102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:49.010 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.563+0000 7fa955600700 1 -- 172.21.15.5:0/4065248326 shutdown_connections 2024-01-24T15:33:49.010 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:48.563+0000 7fa955600700 1 -- 172.21.15.5:0/4065248326 wait complete. 2024-01-24T15:33:49.010 INFO:teuthology.orchestra.run.smithi005.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-01-24T15:33:49.010 INFO:teuthology.orchestra.run.smithi005.stdout:Adding key to root@localhost authorized_keys... 2024-01-24T15:33:49.010 INFO:teuthology.orchestra.run.smithi005.stdout:Adding host smithi005... 2024-01-24T15:33:49.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:49 smithi005 ceph-mon[35346]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:33:50.829 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:50 smithi005 ceph-mon[35346]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi005", "addr": "172.21.15.5", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:33:51.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:51 smithi005 ceph-mon[35346]: Deploying cephadm binary to smithi005 2024-01-24T15:33:52.938 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Added host 'smithi005' with addr '172.21.15.5' 2024-01-24T15:33:52.939 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.384+0000 7fb1c9200700 1 Processor -- start 2024-01-24T15:33:52.939 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.384+0000 7fb1c9200700 1 -- start start 2024-01-24T15:33:52.939 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.384+0000 7fb1c9200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4106620 0x7fb1c4106a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:52.939 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.384+0000 7fb1c9200700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c4107010 con 0x7fb1c4106620 2024-01-24T15:33:52.939 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.385+0000 7fb1c1e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4106620 0x7fb1c4106a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:52.939 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.385+0000 7fb1c1e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4106620 0x7fb1c4106a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60690/0 (socket says 172.21.15.5:60690) 2024-01-24T15:33:52.939 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.385+0000 7fb1c1e00700 1 -- 172.21.15.5:0/1014759038 learned_addr learned my addr 172.21.15.5:0/1014759038 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:52.939 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.385+0000 7fb1c1e00700 1 -- 172.21.15.5:0/1014759038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c4107820 con 0x7fb1c4106620 2024-01-24T15:33:52.939 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.385+0000 7fb1c1e00700 1 --2- 172.21.15.5:0/1014759038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4106620 0x7fb1c4106a40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40098a0 tx=0x7fb1b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a49a50b48c101b server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:52.939 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.385+0000 7fb1c0a00700 1 -- 172.21.15.5:0/1014759038 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1b4004160 con 0x7fb1c4106620 2024-01-24T15:33:52.939 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.385+0000 7fb1c0a00700 1 -- 172.21.15.5:0/1014759038 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fb1b40042c0 con 0x7fb1c4106620 2024-01-24T15:33:52.939 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.385+0000 7fb1c0a00700 1 -- 172.21.15.5:0/1014759038 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1b4011940 con 0x7fb1c4106620 2024-01-24T15:33:52.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.386+0000 7fb1c9200700 1 -- 172.21.15.5:0/1014759038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4106620 msgr2=0x7fb1c4106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:52.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.386+0000 7fb1c9200700 1 --2- 172.21.15.5:0/1014759038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4106620 0x7fb1c4106a40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40098a0 tx=0x7fb1b4009bb0 comp rx=0 tx=0).stop 2024-01-24T15:33:52.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.386+0000 7fb1c9200700 1 -- 172.21.15.5:0/1014759038 shutdown_connections 2024-01-24T15:33:52.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.386+0000 7fb1c9200700 1 --2- 172.21.15.5:0/1014759038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4106620 0x7fb1c4106a40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:52.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.386+0000 7fb1c9200700 1 -- 172.21.15.5:0/1014759038 >> 172.21.15.5:0/1014759038 conn(0x7fb1c4101c00 msgr2=0x7fb1c4104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:52.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.386+0000 7fb1c9200700 1 -- 172.21.15.5:0/1014759038 shutdown_connections 2024-01-24T15:33:52.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.386+0000 7fb1c9200700 1 -- 172.21.15.5:0/1014759038 wait complete. 2024-01-24T15:33:52.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.388+0000 7fb1c9200700 1 Processor -- start 2024-01-24T15:33:52.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.388+0000 7fb1c9200700 1 -- start start 2024-01-24T15:33:52.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.388+0000 7fb1c9200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4106620 0x7fb1c407ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:52.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.388+0000 7fb1c9200700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c407b070 con 0x7fb1c4106620 2024-01-24T15:33:52.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.389+0000 7fb1c1e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4106620 0x7fb1c407ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:52.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.389+0000 7fb1c1e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4106620 0x7fb1c407ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60698/0 (socket says 172.21.15.5:60698) 2024-01-24T15:33:52.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.389+0000 7fb1c1e00700 1 -- 172.21.15.5:0/1222078642 learned_addr learned my addr 172.21.15.5:0/1222078642 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:52.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.389+0000 7fb1c1e00700 1 -- 172.21.15.5:0/1222078642 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b4009550 con 0x7fb1c4106620 2024-01-24T15:33:52.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.389+0000 7fb1c1e00700 1 --2- 172.21.15.5:0/1222078642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4106620 0x7fb1c407ab30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4000c00 tx=0x7fb1b4011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:52.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.389+0000 7fb1baa00700 1 -- 172.21.15.5:0/1222078642 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1b40036a0 con 0x7fb1c4106620 2024-01-24T15:33:52.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.389+0000 7fb1baa00700 1 -- 172.21.15.5:0/1222078642 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fb1b401b440 con 0x7fb1c4106620 2024-01-24T15:33:52.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.389+0000 7fb1c9200700 1 -- 172.21.15.5:0/1222078642 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c4079180 con 0x7fb1c4106620 2024-01-24T15:33:52.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.389+0000 7fb1baa00700 1 -- 172.21.15.5:0/1222078642 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb1b40193f0 con 0x7fb1c4106620 2024-01-24T15:33:52.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.390+0000 7fb1c9200700 1 -- 172.21.15.5:0/1222078642 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c40795a0 con 0x7fb1c4106620 2024-01-24T15:33:52.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.391+0000 7fb1c9200700 1 -- 172.21.15.5:0/1222078642 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c4062370 con 0x7fb1c4106620 2024-01-24T15:33:52.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.391+0000 7fb1baa00700 1 -- 172.21.15.5:0/1222078642 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 45268+0+0 (secure 0 0 0) 0x7fb1b401b5b0 con 0x7fb1c4106620 2024-01-24T15:33:52.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.391+0000 7fb1baa00700 1 --2- 172.21.15.5:0/1222078642 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fb1a4038350 0x7fb1a403a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:52.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.391+0000 7fb1baa00700 1 -- 172.21.15.5:0/1222078642 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb1b404c110 con 0x7fb1c4106620 2024-01-24T15:33:52.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.391+0000 7fb1c1400700 1 --2- 172.21.15.5:0/1222078642 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fb1a4038350 0x7fb1a403a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:52.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.392+0000 7fb1c1400700 1 --2- 172.21.15.5:0/1222078642 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fb1a4038350 0x7fb1a403a810 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac006fd0 tx=0x7fb1ac006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:52.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.396+0000 7fb1baa00700 1 -- 172.21.15.5:0/1222078642 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7fb1b4022950 con 0x7fb1c4106620 2024-01-24T15:33:52.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:49.611+0000 7fb1c9200700 1 -- 172.21.15.5:0/1222078642 --> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi005", "addr": "172.21.15.5", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1c4103070 con 0x7fb1a4038350 2024-01-24T15:33:52.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:52.614+0000 7fb1baa00700 1 -- 172.21.15.5:0/1222078642 <== mgr.14118 v2:172.21.15.5:6800/2286807214 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fb1c4103070 con 0x7fb1a4038350 2024-01-24T15:33:52.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:52.617+0000 7fb1c9200700 1 -- 172.21.15.5:0/1222078642 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fb1a4038350 msgr2=0x7fb1a403a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:52.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:52.617+0000 7fb1c9200700 1 --2- 172.21.15.5:0/1222078642 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fb1a4038350 0x7fb1a403a810 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac006fd0 tx=0x7fb1ac006e40 comp rx=0 tx=0).stop 2024-01-24T15:33:52.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:52.617+0000 7fb1c9200700 1 -- 172.21.15.5:0/1222078642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4106620 msgr2=0x7fb1c407ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:52.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:52.617+0000 7fb1c9200700 1 --2- 172.21.15.5:0/1222078642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4106620 0x7fb1c407ab30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4000c00 tx=0x7fb1b4011e70 comp rx=0 tx=0).stop 2024-01-24T15:33:52.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:52.617+0000 7fb1c9200700 1 -- 172.21.15.5:0/1222078642 shutdown_connections 2024-01-24T15:33:52.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:52.617+0000 7fb1c9200700 1 --2- 172.21.15.5:0/1222078642 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fb1a4038350 0x7fb1a403a810 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:52.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:52.617+0000 7fb1c9200700 1 --2- 172.21.15.5:0/1222078642 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1c4106620 0x7fb1c407ab30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:52.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:52.617+0000 7fb1c9200700 1 -- 172.21.15.5:0/1222078642 >> 172.21.15.5:0/1222078642 conn(0x7fb1c4101c00 msgr2=0x7fb1c4102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:52.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:52.618+0000 7fb1c9200700 1 -- 172.21.15.5:0/1222078642 shutdown_connections 2024-01-24T15:33:52.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:52.618+0000 7fb1c9200700 1 -- 172.21.15.5:0/1222078642 wait complete. 2024-01-24T15:33:52.942 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying unmanaged mon service... 2024-01-24T15:33:53.795 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:53 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' 2024-01-24T15:33:53.795 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:53 smithi005 ceph-mon[35346]: Added host smithi005 2024-01-24T15:33:53.795 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:53 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:33:54.036 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-01-24T15:33:54.037 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.344+0000 7fde1e600700 1 Processor -- start 2024-01-24T15:33:54.037 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.344+0000 7fde1e600700 1 -- start start 2024-01-24T15:33:54.037 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.344+0000 7fde1e600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde1807ad40 0x7fde180791a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:54.037 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.344+0000 7fde1e600700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde18079770 con 0x7fde1807ad40 2024-01-24T15:33:54.037 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.345+0000 7fde1d200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde1807ad40 0x7fde180791a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:54.037 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.345+0000 7fde1d200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde1807ad40 0x7fde180791a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48624/0 (socket says 172.21.15.5:48624) 2024-01-24T15:33:54.037 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.345+0000 7fde1d200700 1 -- 172.21.15.5:0/3456554759 learned_addr learned my addr 172.21.15.5:0/3456554759 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:54.037 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.345+0000 7fde1d200700 1 -- 172.21.15.5:0/3456554759 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde180798b0 con 0x7fde1807ad40 2024-01-24T15:33:54.037 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.345+0000 7fde1d200700 1 --2- 172.21.15.5:0/3456554759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde1807ad40 0x7fde180791a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fde080098a0 tx=0x7fde08009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37397df2e2127d30 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:54.037 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.346+0000 7fde17400700 1 -- 172.21.15.5:0/3456554759 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde08004160 con 0x7fde1807ad40 2024-01-24T15:33:54.038 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.346+0000 7fde17400700 1 -- 172.21.15.5:0/3456554759 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fde080042c0 con 0x7fde1807ad40 2024-01-24T15:33:54.038 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.346+0000 7fde17400700 1 -- 172.21.15.5:0/3456554759 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde08011940 con 0x7fde1807ad40 2024-01-24T15:33:54.038 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.346+0000 7fde1e600700 1 -- 172.21.15.5:0/3456554759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde1807ad40 msgr2=0x7fde180791a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:54.038 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.346+0000 7fde1e600700 1 --2- 172.21.15.5:0/3456554759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde1807ad40 0x7fde180791a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fde080098a0 tx=0x7fde08009bb0 comp rx=0 tx=0).stop 2024-01-24T15:33:54.038 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.346+0000 7fde1e600700 1 -- 172.21.15.5:0/3456554759 shutdown_connections 2024-01-24T15:33:54.038 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.346+0000 7fde1e600700 1 --2- 172.21.15.5:0/3456554759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde1807ad40 0x7fde180791a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:54.038 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.346+0000 7fde1e600700 1 -- 172.21.15.5:0/3456554759 >> 172.21.15.5:0/3456554759 conn(0x7fde18101a00 msgr2=0x7fde18103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:54.038 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.347+0000 7fde1e600700 1 -- 172.21.15.5:0/3456554759 shutdown_connections 2024-01-24T15:33:54.038 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.347+0000 7fde1e600700 1 -- 172.21.15.5:0/3456554759 wait complete. 2024-01-24T15:33:54.038 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.348+0000 7fde1e600700 1 Processor -- start 2024-01-24T15:33:54.038 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.348+0000 7fde1e600700 1 -- start start 2024-01-24T15:33:54.038 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.348+0000 7fde1e600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde1807ad40 0x7fde1819c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:54.038 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.348+0000 7fde1e600700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1819c6f0 con 0x7fde1807ad40 2024-01-24T15:33:54.039 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.349+0000 7fde1d200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde1807ad40 0x7fde1819c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:54.039 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.349+0000 7fde1d200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde1807ad40 0x7fde1819c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48636/0 (socket says 172.21.15.5:48636) 2024-01-24T15:33:54.039 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.349+0000 7fde1d200700 1 -- 172.21.15.5:0/2725769377 learned_addr learned my addr 172.21.15.5:0/2725769377 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:54.039 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.349+0000 7fde1d200700 1 -- 172.21.15.5:0/2725769377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde08009550 con 0x7fde1807ad40 2024-01-24T15:33:54.039 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.349+0000 7fde1d200700 1 --2- 172.21.15.5:0/2725769377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde1807ad40 0x7fde1819c1b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fde08011dc0 tx=0x7fde08011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:54.039 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.349+0000 7fde15600700 1 -- 172.21.15.5:0/2725769377 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde080037d0 con 0x7fde1807ad40 2024-01-24T15:33:54.039 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.349+0000 7fde15600700 1 -- 172.21.15.5:0/2725769377 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fde0801b440 con 0x7fde1807ad40 2024-01-24T15:33:54.039 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.349+0000 7fde15600700 1 -- 172.21.15.5:0/2725769377 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde0801a560 con 0x7fde1807ad40 2024-01-24T15:33:54.039 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.349+0000 7fde1e600700 1 -- 172.21.15.5:0/2725769377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde1819c8f0 con 0x7fde1807ad40 2024-01-24T15:33:54.039 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.350+0000 7fde1e600700 1 -- 172.21.15.5:0/2725769377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde1819cd10 con 0x7fde1807ad40 2024-01-24T15:33:54.039 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.351+0000 7fde15600700 1 -- 172.21.15.5:0/2725769377 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 45268+0+0 (secure 0 0 0) 0x7fde08003930 con 0x7fde1807ad40 2024-01-24T15:33:54.039 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.351+0000 7fde15600700 1 --2- 172.21.15.5:0/2725769377 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fddf8038350 0x7fddf803a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:54.039 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.351+0000 7fde1e600700 1 -- 172.21.15.5:0/2725769377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde18062370 con 0x7fde1807ad40 2024-01-24T15:33:54.039 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.351+0000 7fde15600700 1 -- 172.21.15.5:0/2725769377 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fde0804c170 con 0x7fde1807ad40 2024-01-24T15:33:54.040 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.351+0000 7fde17e00700 1 --2- 172.21.15.5:0/2725769377 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fddf8038350 0x7fddf803a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:54.040 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.352+0000 7fde17e00700 1 --2- 172.21.15.5:0/2725769377 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fddf8038350 0x7fddf803a810 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fde00006fd0 tx=0x7fde00006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:54.040 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.357+0000 7fde15600700 1 -- 172.21.15.5:0/2725769377 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7fde0801f020 con 0x7fde1807ad40 2024-01-24T15:33:54.040 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.617+0000 7fde1e600700 1 -- 172.21.15.5:0/2725769377 --> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fde18102e20 con 0x7fddf8038350 2024-01-24T15:33:54.040 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.623+0000 7fde15600700 1 -- 172.21.15.5:0/2725769377 <== mgr.14118 v2:172.21.15.5:6800/2286807214 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fde18102e20 con 0x7fddf8038350 2024-01-24T15:33:54.040 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.625+0000 7fde1e600700 1 -- 172.21.15.5:0/2725769377 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fddf8038350 msgr2=0x7fddf803a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:54.040 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.625+0000 7fde1e600700 1 --2- 172.21.15.5:0/2725769377 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fddf8038350 0x7fddf803a810 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fde00006fd0 tx=0x7fde00006e40 comp rx=0 tx=0).stop 2024-01-24T15:33:54.040 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.625+0000 7fde1e600700 1 -- 172.21.15.5:0/2725769377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde1807ad40 msgr2=0x7fde1819c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:54.040 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.625+0000 7fde1e600700 1 --2- 172.21.15.5:0/2725769377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde1807ad40 0x7fde1819c1b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fde08011dc0 tx=0x7fde08011ea0 comp rx=0 tx=0).stop 2024-01-24T15:33:54.040 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.625+0000 7fde1e600700 1 -- 172.21.15.5:0/2725769377 shutdown_connections 2024-01-24T15:33:54.040 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.625+0000 7fde1e600700 1 --2- 172.21.15.5:0/2725769377 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fddf8038350 0x7fddf803a810 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:54.040 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.625+0000 7fde1e600700 1 --2- 172.21.15.5:0/2725769377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fde1807ad40 0x7fde1819c1b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:54.040 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.625+0000 7fde1e600700 1 -- 172.21.15.5:0/2725769377 >> 172.21.15.5:0/2725769377 conn(0x7fde18101a00 msgr2=0x7fde18102710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:54.040 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.625+0000 7fde1e600700 1 -- 172.21.15.5:0/2725769377 shutdown_connections 2024-01-24T15:33:54.041 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:53.625+0000 7fde1e600700 1 -- 172.21.15.5:0/2725769377 wait complete. 2024-01-24T15:33:54.041 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying unmanaged mgr service... 2024-01-24T15:33:54.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:54 smithi005 ceph-mon[35346]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:33:54.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:54 smithi005 ceph-mon[35346]: Saving service mon spec with placement count:5 2024-01-24T15:33:54.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:54 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' 2024-01-24T15:33:54.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:54 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' 2024-01-24T15:33:54.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:54 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' 2024-01-24T15:33:54.992 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-01-24T15:33:54.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.465+0000 7fe0bae00700 1 Processor -- start 2024-01-24T15:33:54.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.466+0000 7fe0bae00700 1 -- start start 2024-01-24T15:33:54.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.466+0000 7fe0bae00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0b4106620 0x7fe0b4106a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:54.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.466+0000 7fe0bae00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b4107010 con 0x7fe0b4106620 2024-01-24T15:33:54.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.467+0000 7fe0b3e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0b4106620 0x7fe0b4106a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:54.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.467+0000 7fe0b3e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0b4106620 0x7fe0b4106a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48652/0 (socket says 172.21.15.5:48652) 2024-01-24T15:33:54.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.467+0000 7fe0b3e00700 1 -- 172.21.15.5:0/2400119224 learned_addr learned my addr 172.21.15.5:0/2400119224 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:54.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.467+0000 7fe0b3e00700 1 -- 172.21.15.5:0/2400119224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b4107820 con 0x7fe0b4106620 2024-01-24T15:33:54.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.467+0000 7fe0b3e00700 1 --2- 172.21.15.5:0/2400119224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0b4106620 0x7fe0b4106a40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe0a40098a0 tx=0x7fe0a4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320c567747d0dbae server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:54.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.468+0000 7fe0b2a00700 1 -- 172.21.15.5:0/2400119224 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0a4004160 con 0x7fe0b4106620 2024-01-24T15:33:54.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.468+0000 7fe0b2a00700 1 -- 172.21.15.5:0/2400119224 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe0a40042c0 con 0x7fe0b4106620 2024-01-24T15:33:54.993 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.468+0000 7fe0b2a00700 1 -- 172.21.15.5:0/2400119224 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0a40118e0 con 0x7fe0b4106620 2024-01-24T15:33:54.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.468+0000 7fe0bae00700 1 -- 172.21.15.5:0/2400119224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0b4106620 msgr2=0x7fe0b4106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:54.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.468+0000 7fe0bae00700 1 --2- 172.21.15.5:0/2400119224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0b4106620 0x7fe0b4106a40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe0a40098a0 tx=0x7fe0a4009bb0 comp rx=0 tx=0).stop 2024-01-24T15:33:54.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.468+0000 7fe0bae00700 1 -- 172.21.15.5:0/2400119224 shutdown_connections 2024-01-24T15:33:54.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.468+0000 7fe0bae00700 1 --2- 172.21.15.5:0/2400119224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0b4106620 0x7fe0b4106a40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:54.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.468+0000 7fe0bae00700 1 -- 172.21.15.5:0/2400119224 >> 172.21.15.5:0/2400119224 conn(0x7fe0b4101c00 msgr2=0x7fe0b4104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:54.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.468+0000 7fe0bae00700 1 -- 172.21.15.5:0/2400119224 shutdown_connections 2024-01-24T15:33:54.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.469+0000 7fe0bae00700 1 -- 172.21.15.5:0/2400119224 wait complete. 2024-01-24T15:33:54.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.470+0000 7fe0bae00700 1 Processor -- start 2024-01-24T15:33:54.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.470+0000 7fe0bae00700 1 -- start start 2024-01-24T15:33:54.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.470+0000 7fe0bae00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0b4106620 0x7fe0b419c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:54.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.470+0000 7fe0bae00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b419ca00 con 0x7fe0b4106620 2024-01-24T15:33:54.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.470+0000 7fe0b3e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0b4106620 0x7fe0b419c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:54.994 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.471+0000 7fe0b3e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0b4106620 0x7fe0b419c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48664/0 (socket says 172.21.15.5:48664) 2024-01-24T15:33:54.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.471+0000 7fe0b3e00700 1 -- 172.21.15.5:0/50210730 learned_addr learned my addr 172.21.15.5:0/50210730 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:54.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.471+0000 7fe0b3e00700 1 -- 172.21.15.5:0/50210730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a4009550 con 0x7fe0b4106620 2024-01-24T15:33:54.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.471+0000 7fe0b3e00700 1 --2- 172.21.15.5:0/50210730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0b4106620 0x7fe0b419c4c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4000c00 tx=0x7fe0a40119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:54.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.471+0000 7fe0b0c00700 1 -- 172.21.15.5:0/50210730 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0a40036a0 con 0x7fe0b4106620 2024-01-24T15:33:54.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.471+0000 7fe0b0c00700 1 -- 172.21.15.5:0/50210730 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe0a401b440 con 0x7fe0b4106620 2024-01-24T15:33:54.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.471+0000 7fe0bae00700 1 -- 172.21.15.5:0/50210730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b419cc00 con 0x7fe0b4106620 2024-01-24T15:33:54.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.471+0000 7fe0b0c00700 1 -- 172.21.15.5:0/50210730 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0a401a3d0 con 0x7fe0b4106620 2024-01-24T15:33:54.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.472+0000 7fe0bae00700 1 -- 172.21.15.5:0/50210730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b419d020 con 0x7fe0b4106620 2024-01-24T15:33:54.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.473+0000 7fe0b0c00700 1 -- 172.21.15.5:0/50210730 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 45268+0+0 (secure 0 0 0) 0x7fe0a4003800 con 0x7fe0b4106620 2024-01-24T15:33:54.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.473+0000 7fe0bae00700 1 -- 172.21.15.5:0/50210730 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b4062370 con 0x7fe0b4106620 2024-01-24T15:33:54.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.473+0000 7fe0b0c00700 1 --2- 172.21.15.5:0/50210730 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fe094038350 0x7fe09403a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:54.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.473+0000 7fe0b0c00700 1 -- 172.21.15.5:0/50210730 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe0a404c0c0 con 0x7fe0b4106620 2024-01-24T15:33:54.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.474+0000 7fe0b3400700 1 --2- 172.21.15.5:0/50210730 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fe094038350 0x7fe09403a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:54.995 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.474+0000 7fe0b3400700 1 --2- 172.21.15.5:0/50210730 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fe094038350 0x7fe09403a810 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe09c006fd0 tx=0x7fe09c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:54.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.479+0000 7fe0b0c00700 1 -- 172.21.15.5:0/50210730 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7fe0a407f120 con 0x7fe0b4106620 2024-01-24T15:33:54.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.704+0000 7fe0bae00700 1 -- 172.21.15.5:0/50210730 --> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fe0b4103ed0 con 0x7fe094038350 2024-01-24T15:33:54.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.710+0000 7fe0b0c00700 1 -- 172.21.15.5:0/50210730 <== mgr.14118 v2:172.21.15.5:6800/2286807214 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fe0b4103ed0 con 0x7fe094038350 2024-01-24T15:33:54.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.712+0000 7fe0bae00700 1 -- 172.21.15.5:0/50210730 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fe094038350 msgr2=0x7fe09403a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:54.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.712+0000 7fe0bae00700 1 --2- 172.21.15.5:0/50210730 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fe094038350 0x7fe09403a810 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe09c006fd0 tx=0x7fe09c006e40 comp rx=0 tx=0).stop 2024-01-24T15:33:54.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.712+0000 7fe0bae00700 1 -- 172.21.15.5:0/50210730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0b4106620 msgr2=0x7fe0b419c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:54.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.712+0000 7fe0bae00700 1 --2- 172.21.15.5:0/50210730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0b4106620 0x7fe0b419c4c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4000c00 tx=0x7fe0a40119a0 comp rx=0 tx=0).stop 2024-01-24T15:33:54.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.712+0000 7fe0bae00700 1 -- 172.21.15.5:0/50210730 shutdown_connections 2024-01-24T15:33:54.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.712+0000 7fe0bae00700 1 --2- 172.21.15.5:0/50210730 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fe094038350 0x7fe09403a810 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:54.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.712+0000 7fe0bae00700 1 --2- 172.21.15.5:0/50210730 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0b4106620 0x7fe0b419c4c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:54.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.712+0000 7fe0bae00700 1 -- 172.21.15.5:0/50210730 >> 172.21.15.5:0/50210730 conn(0x7fe0b4101c00 msgr2=0x7fe0b41032b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:54.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.713+0000 7fe0bae00700 1 -- 172.21.15.5:0/50210730 shutdown_connections 2024-01-24T15:33:54.996 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:54.713+0000 7fe0bae00700 1 -- 172.21.15.5:0/50210730 wait complete. 2024-01-24T15:33:55.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:55 smithi005 ceph-mon[35346]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:33:55.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:55 smithi005 ceph-mon[35346]: Saving service mgr spec with placement count:2 2024-01-24T15:33:55.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:55 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' 2024-01-24T15:33:55.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:55 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/758783254' entity='client.admin' 2024-01-24T15:33:55.963 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.388+0000 7f3b7e600700 1 Processor -- start 2024-01-24T15:33:55.963 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.388+0000 7f3b7e600700 1 -- start start 2024-01-24T15:33:55.963 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.388+0000 7f3b7e600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b7807adc0 0x7f3b78079220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:55.968 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.388+0000 7f3b7e600700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b780797f0 con 0x7f3b7807adc0 2024-01-24T15:33:55.968 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.388+0000 7f3b77400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b7807adc0 0x7f3b78079220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:55.969 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.389+0000 7f3b77400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b7807adc0 0x7f3b78079220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48676/0 (socket says 172.21.15.5:48676) 2024-01-24T15:33:55.969 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.389+0000 7f3b77400700 1 -- 172.21.15.5:0/1140161785 learned_addr learned my addr 172.21.15.5:0/1140161785 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:55.969 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.389+0000 7f3b77400700 1 -- 172.21.15.5:0/1140161785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b78079930 con 0x7f3b7807adc0 2024-01-24T15:33:55.969 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.389+0000 7f3b77400700 1 --2- 172.21.15.5:0/1140161785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b7807adc0 0x7f3b78079220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3b680098a0 tx=0x7f3b68009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5838f3d2253c9371 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:55.969 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.389+0000 7f3b76000700 1 -- 172.21.15.5:0/1140161785 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b68004160 con 0x7f3b7807adc0 2024-01-24T15:33:55.969 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.389+0000 7f3b76000700 1 -- 172.21.15.5:0/1140161785 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b680042c0 con 0x7f3b7807adc0 2024-01-24T15:33:55.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.389+0000 7f3b76000700 1 -- 172.21.15.5:0/1140161785 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b680118e0 con 0x7f3b7807adc0 2024-01-24T15:33:55.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.390+0000 7f3b7e600700 1 -- 172.21.15.5:0/1140161785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b7807adc0 msgr2=0x7f3b78079220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:55.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.390+0000 7f3b7e600700 1 --2- 172.21.15.5:0/1140161785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b7807adc0 0x7f3b78079220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3b680098a0 tx=0x7f3b68009bb0 comp rx=0 tx=0).stop 2024-01-24T15:33:55.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.390+0000 7f3b7e600700 1 -- 172.21.15.5:0/1140161785 shutdown_connections 2024-01-24T15:33:55.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.390+0000 7f3b7e600700 1 --2- 172.21.15.5:0/1140161785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b7807adc0 0x7f3b78079220 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:55.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.390+0000 7f3b7e600700 1 -- 172.21.15.5:0/1140161785 >> 172.21.15.5:0/1140161785 conn(0x7f3b78101c00 msgr2=0x7f3b78104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:55.970 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.390+0000 7f3b7e600700 1 -- 172.21.15.5:0/1140161785 shutdown_connections 2024-01-24T15:33:55.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.390+0000 7f3b7e600700 1 -- 172.21.15.5:0/1140161785 wait complete. 2024-01-24T15:33:55.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.392+0000 7f3b7e600700 1 Processor -- start 2024-01-24T15:33:55.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.392+0000 7f3b7e600700 1 -- start start 2024-01-24T15:33:55.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.392+0000 7f3b7e600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b7807adc0 0x7f3b781a08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:55.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.392+0000 7f3b7e600700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b781a0de0 con 0x7f3b7807adc0 2024-01-24T15:33:55.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.393+0000 7f3b77400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b7807adc0 0x7f3b781a08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:55.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.393+0000 7f3b77400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b7807adc0 0x7f3b781a08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48686/0 (socket says 172.21.15.5:48686) 2024-01-24T15:33:55.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.393+0000 7f3b77400700 1 -- 172.21.15.5:0/758783254 learned_addr learned my addr 172.21.15.5:0/758783254 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:55.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.393+0000 7f3b77400700 1 -- 172.21.15.5:0/758783254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b68009550 con 0x7f3b7807adc0 2024-01-24T15:33:55.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.393+0000 7f3b77400700 1 --2- 172.21.15.5:0/758783254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b7807adc0 0x7f3b781a08a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3b68000c00 tx=0x7f3b680119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:55.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.394+0000 7f3b6fe00700 1 -- 172.21.15.5:0/758783254 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b680036a0 con 0x7f3b7807adc0 2024-01-24T15:33:55.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.394+0000 7f3b6fe00700 1 -- 172.21.15.5:0/758783254 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3b6801b440 con 0x7f3b7807adc0 2024-01-24T15:33:55.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.394+0000 7f3b7e600700 1 -- 172.21.15.5:0/758783254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b781a0fe0 con 0x7f3b7807adc0 2024-01-24T15:33:55.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.394+0000 7f3b6fe00700 1 -- 172.21.15.5:0/758783254 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b6801a3d0 con 0x7f3b7807adc0 2024-01-24T15:33:55.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.394+0000 7f3b7e600700 1 -- 172.21.15.5:0/758783254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b781a1400 con 0x7f3b7807adc0 2024-01-24T15:33:55.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.395+0000 7f3b7e600700 1 -- 172.21.15.5:0/758783254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b78062370 con 0x7f3b7807adc0 2024-01-24T15:33:55.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.396+0000 7f3b6fe00700 1 -- 172.21.15.5:0/758783254 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 45268+0+0 (secure 0 0 0) 0x7f3b6801b5b0 con 0x7f3b7807adc0 2024-01-24T15:33:55.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.396+0000 7f3b6fe00700 1 --2- 172.21.15.5:0/758783254 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f3b58038300 0x7f3b5803a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:55.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.396+0000 7f3b6fe00700 1 -- 172.21.15.5:0/758783254 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3b6804c050 con 0x7f3b7807adc0 2024-01-24T15:33:55.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.396+0000 7f3b76a00700 1 --2- 172.21.15.5:0/758783254 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f3b58038300 0x7f3b5803a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:55.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.397+0000 7f3b76a00700 1 --2- 172.21.15.5:0/758783254 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f3b58038300 0x7f3b5803a7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3b60006fd0 tx=0x7f3b60006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:55.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.401+0000 7f3b6fe00700 1 -- 172.21.15.5:0/758783254 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f3b68023a00 con 0x7f3b7807adc0 2024-01-24T15:33:55.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.616+0000 7f3b7e600700 1 -- 172.21.15.5:0/758783254 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f3b781a4260 con 0x7f3b7807adc0 2024-01-24T15:33:55.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.620+0000 7f3b6fe00700 1 -- 172.21.15.5:0/758783254 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f3b6801f070 con 0x7f3b7807adc0 2024-01-24T15:33:55.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.622+0000 7f3b7e600700 1 -- 172.21.15.5:0/758783254 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f3b58038300 msgr2=0x7f3b5803a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:55.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.622+0000 7f3b7e600700 1 --2- 172.21.15.5:0/758783254 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f3b58038300 0x7f3b5803a7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3b60006fd0 tx=0x7f3b60006e40 comp rx=0 tx=0).stop 2024-01-24T15:33:55.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.622+0000 7f3b7e600700 1 -- 172.21.15.5:0/758783254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b7807adc0 msgr2=0x7f3b781a08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:55.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.622+0000 7f3b7e600700 1 --2- 172.21.15.5:0/758783254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b7807adc0 0x7f3b781a08a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3b68000c00 tx=0x7f3b680119a0 comp rx=0 tx=0).stop 2024-01-24T15:33:55.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.622+0000 7f3b7e600700 1 -- 172.21.15.5:0/758783254 shutdown_connections 2024-01-24T15:33:55.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.622+0000 7f3b7e600700 1 --2- 172.21.15.5:0/758783254 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f3b58038300 0x7f3b5803a7c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:55.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.622+0000 7f3b7e600700 1 --2- 172.21.15.5:0/758783254 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b7807adc0 0x7f3b781a08a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:55.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.622+0000 7f3b7e600700 1 -- 172.21.15.5:0/758783254 >> 172.21.15.5:0/758783254 conn(0x7f3b78101c00 msgr2=0x7f3b781077c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:55.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.623+0000 7f3b7e600700 1 -- 172.21.15.5:0/758783254 shutdown_connections 2024-01-24T15:33:55.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:55.623+0000 7f3b7e600700 1 -- 172.21.15.5:0/758783254 wait complete. 2024-01-24T15:33:56.939 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.355+0000 7fad9be00700 1 Processor -- start 2024-01-24T15:33:56.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.355+0000 7fad9be00700 1 -- start start 2024-01-24T15:33:56.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.355+0000 7fad9be00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9407ad60 0x7fad940791c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:56.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.355+0000 7fad9be00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad94079790 con 0x7fad9407ad60 2024-01-24T15:33:56.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.355+0000 7fad99400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9407ad60 0x7fad940791c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:56.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.355+0000 7fad99400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9407ad60 0x7fad940791c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48694/0 (socket says 172.21.15.5:48694) 2024-01-24T15:33:56.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.355+0000 7fad99400700 1 -- 172.21.15.5:0/1598787997 learned_addr learned my addr 172.21.15.5:0/1598787997 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:56.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.356+0000 7fad99400700 1 -- 172.21.15.5:0/1598787997 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad940798d0 con 0x7fad9407ad60 2024-01-24T15:33:56.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.356+0000 7fad99400700 1 --2- 172.21.15.5:0/1598787997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9407ad60 0x7fad940791c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fad840098a0 tx=0x7fad84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9400a50b1e5443 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:56.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.356+0000 7fad93e00700 1 -- 172.21.15.5:0/1598787997 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad84004160 con 0x7fad9407ad60 2024-01-24T15:33:56.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.356+0000 7fad93e00700 1 -- 172.21.15.5:0/1598787997 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad840042c0 con 0x7fad9407ad60 2024-01-24T15:33:56.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.356+0000 7fad93e00700 1 -- 172.21.15.5:0/1598787997 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad840118e0 con 0x7fad9407ad60 2024-01-24T15:33:56.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.357+0000 7fad9be00700 1 -- 172.21.15.5:0/1598787997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9407ad60 msgr2=0x7fad940791c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:56.940 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.357+0000 7fad9be00700 1 --2- 172.21.15.5:0/1598787997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9407ad60 0x7fad940791c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fad840098a0 tx=0x7fad84009bb0 comp rx=0 tx=0).stop 2024-01-24T15:33:56.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.357+0000 7fad9be00700 1 -- 172.21.15.5:0/1598787997 shutdown_connections 2024-01-24T15:33:56.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.357+0000 7fad9be00700 1 --2- 172.21.15.5:0/1598787997 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9407ad60 0x7fad940791c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:56.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.357+0000 7fad9be00700 1 -- 172.21.15.5:0/1598787997 >> 172.21.15.5:0/1598787997 conn(0x7fad94101c00 msgr2=0x7fad94104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:56.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.357+0000 7fad9be00700 1 -- 172.21.15.5:0/1598787997 shutdown_connections 2024-01-24T15:33:56.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.357+0000 7fad9be00700 1 -- 172.21.15.5:0/1598787997 wait complete. 2024-01-24T15:33:56.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.359+0000 7fad9be00700 1 Processor -- start 2024-01-24T15:33:56.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.359+0000 7fad9be00700 1 -- start start 2024-01-24T15:33:56.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.359+0000 7fad9be00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9407ad60 0x7fad9419c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:56.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.359+0000 7fad9be00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9419c9b0 con 0x7fad9407ad60 2024-01-24T15:33:56.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.360+0000 7fad99400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9407ad60 0x7fad9419c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:56.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.360+0000 7fad99400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9407ad60 0x7fad9419c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48696/0 (socket says 172.21.15.5:48696) 2024-01-24T15:33:56.941 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.360+0000 7fad99400700 1 -- 172.21.15.5:0/2707240271 learned_addr learned my addr 172.21.15.5:0/2707240271 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:56.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.360+0000 7fad99400700 1 -- 172.21.15.5:0/2707240271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad84009550 con 0x7fad9407ad60 2024-01-24T15:33:56.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.360+0000 7fad99400700 1 --2- 172.21.15.5:0/2707240271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9407ad60 0x7fad9419c470 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fad840118f0 tx=0x7fad840119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:56.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.360+0000 7fad92000700 1 -- 172.21.15.5:0/2707240271 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad840036a0 con 0x7fad9407ad60 2024-01-24T15:33:56.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.360+0000 7fad92000700 1 -- 172.21.15.5:0/2707240271 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad8401b440 con 0x7fad9407ad60 2024-01-24T15:33:56.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.360+0000 7fad92000700 1 -- 172.21.15.5:0/2707240271 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad840193f0 con 0x7fad9407ad60 2024-01-24T15:33:56.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.361+0000 7fad9be00700 1 -- 172.21.15.5:0/2707240271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9419cbb0 con 0x7fad9407ad60 2024-01-24T15:33:56.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.361+0000 7fad9be00700 1 -- 172.21.15.5:0/2707240271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9419cfd0 con 0x7fad9407ad60 2024-01-24T15:33:56.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.362+0000 7fad92000700 1 -- 172.21.15.5:0/2707240271 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 45268+0+0 (secure 0 0 0) 0x7fad8401b5b0 con 0x7fad9407ad60 2024-01-24T15:33:56.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.362+0000 7fad9be00700 1 -- 172.21.15.5:0/2707240271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad9410ca00 con 0x7fad9407ad60 2024-01-24T15:33:56.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.362+0000 7fad92000700 1 --2- 172.21.15.5:0/2707240271 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fad74038350 0x7fad7403a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:56.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.362+0000 7fad92000700 1 -- 172.21.15.5:0/2707240271 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fad8404c0f0 con 0x7fad9407ad60 2024-01-24T15:33:56.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.363+0000 7fad98a00700 1 --2- 172.21.15.5:0/2707240271 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fad74038350 0x7fad7403a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:56.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.363+0000 7fad98a00700 1 --2- 172.21.15.5:0/2707240271 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fad74038350 0x7fad7403a810 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fad7c006fd0 tx=0x7fad7c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:56.942 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.367+0000 7fad92000700 1 -- 172.21.15.5:0/2707240271 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7fad8407f120 con 0x7fad9407ad60 2024-01-24T15:33:56.943 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.578+0000 7fad9be00700 1 -- 172.21.15.5:0/2707240271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fad9419fe30 con 0x7fad9407ad60 2024-01-24T15:33:56.943 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.582+0000 7fad92000700 1 -- 172.21.15.5:0/2707240271 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fad8401f070 con 0x7fad9407ad60 2024-01-24T15:33:56.943 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.584+0000 7fad9be00700 1 -- 172.21.15.5:0/2707240271 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fad74038350 msgr2=0x7fad7403a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:56.943 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.584+0000 7fad9be00700 1 --2- 172.21.15.5:0/2707240271 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fad74038350 0x7fad7403a810 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fad7c006fd0 tx=0x7fad7c006e40 comp rx=0 tx=0).stop 2024-01-24T15:33:56.943 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.584+0000 7fad9be00700 1 -- 172.21.15.5:0/2707240271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9407ad60 msgr2=0x7fad9419c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:56.943 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.584+0000 7fad9be00700 1 --2- 172.21.15.5:0/2707240271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9407ad60 0x7fad9419c470 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fad840118f0 tx=0x7fad840119d0 comp rx=0 tx=0).stop 2024-01-24T15:33:56.943 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.584+0000 7fad9be00700 1 -- 172.21.15.5:0/2707240271 shutdown_connections 2024-01-24T15:33:56.943 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.585+0000 7fad9be00700 1 --2- 172.21.15.5:0/2707240271 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7fad74038350 0x7fad7403a810 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:56.943 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.585+0000 7fad9be00700 1 --2- 172.21.15.5:0/2707240271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fad9407ad60 0x7fad9419c470 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:56.943 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.585+0000 7fad9be00700 1 -- 172.21.15.5:0/2707240271 >> 172.21.15.5:0/2707240271 conn(0x7fad94101c00 msgr2=0x7fad941029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:56.943 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.585+0000 7fad9be00700 1 -- 172.21.15.5:0/2707240271 shutdown_connections 2024-01-24T15:33:56.943 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:56.585+0000 7fad9be00700 1 -- 172.21.15.5:0/2707240271 wait complete. 2024-01-24T15:33:56.943 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling the dashboard module... 2024-01-24T15:33:57.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:56 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' 2024-01-24T15:33:57.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:56 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/2707240271' entity='client.admin' 2024-01-24T15:33:58.415 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:58 smithi005 ceph-mon[35346]: from='mgr.14118 172.21.15.5:0/4145419000' entity='mgr.x' 2024-01-24T15:33:58.415 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:58 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/701599741' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-01-24T15:33:58.683 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:58 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: ignoring --setuser ceph since I am not root 2024-01-24T15:33:58.683 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:58 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: ignoring --setgroup ceph since I am not root 2024-01-24T15:33:58.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.403+0000 7f3d86600700 1 Processor -- start 2024-01-24T15:33:58.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.403+0000 7f3d86600700 1 -- start start 2024-01-24T15:33:58.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.404+0000 7f3d86600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8007ad60 0x7f3d800791c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:58.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.404+0000 7f3d86600700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d80079790 con 0x7f3d8007ad60 2024-01-24T15:33:58.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.404+0000 7f3d7f400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8007ad60 0x7f3d800791c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:58.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.404+0000 7f3d7f400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8007ad60 0x7f3d800791c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48708/0 (socket says 172.21.15.5:48708) 2024-01-24T15:33:58.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.404+0000 7f3d7f400700 1 -- 172.21.15.5:0/3329210377 learned_addr learned my addr 172.21.15.5:0/3329210377 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:58.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.404+0000 7f3d7f400700 1 -- 172.21.15.5:0/3329210377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d800798d0 con 0x7f3d8007ad60 2024-01-24T15:33:58.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.405+0000 7f3d7f400700 1 --2- 172.21.15.5:0/3329210377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8007ad60 0x7f3d800791c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3d700098a0 tx=0x7f3d70009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56051d7f7b942430 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:58.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.405+0000 7f3d7e000700 1 -- 172.21.15.5:0/3329210377 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d70004160 con 0x7f3d8007ad60 2024-01-24T15:33:58.758 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.405+0000 7f3d7e000700 1 -- 172.21.15.5:0/3329210377 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3d700042c0 con 0x7f3d8007ad60 2024-01-24T15:33:58.758 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.405+0000 7f3d7e000700 1 -- 172.21.15.5:0/3329210377 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d700118e0 con 0x7f3d8007ad60 2024-01-24T15:33:58.758 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.406+0000 7f3d86600700 1 -- 172.21.15.5:0/3329210377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8007ad60 msgr2=0x7f3d800791c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:58.758 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.406+0000 7f3d86600700 1 --2- 172.21.15.5:0/3329210377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8007ad60 0x7f3d800791c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3d700098a0 tx=0x7f3d70009bb0 comp rx=0 tx=0).stop 2024-01-24T15:33:58.758 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.406+0000 7f3d86600700 1 -- 172.21.15.5:0/3329210377 shutdown_connections 2024-01-24T15:33:58.758 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.406+0000 7f3d86600700 1 --2- 172.21.15.5:0/3329210377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8007ad60 0x7f3d800791c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:58.758 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.406+0000 7f3d86600700 1 -- 172.21.15.5:0/3329210377 >> 172.21.15.5:0/3329210377 conn(0x7f3d80101c00 msgr2=0x7f3d80104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:58.758 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.406+0000 7f3d86600700 1 -- 172.21.15.5:0/3329210377 shutdown_connections 2024-01-24T15:33:58.758 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.406+0000 7f3d86600700 1 -- 172.21.15.5:0/3329210377 wait complete. 2024-01-24T15:33:58.758 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.407+0000 7f3d86600700 1 Processor -- start 2024-01-24T15:33:58.758 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.407+0000 7f3d86600700 1 -- start start 2024-01-24T15:33:58.759 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.408+0000 7f3d86600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8007ad60 0x7f3d8019c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:58.759 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.408+0000 7f3d86600700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8019c9b0 con 0x7f3d8007ad60 2024-01-24T15:33:58.759 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.408+0000 7f3d7f400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8007ad60 0x7f3d8019c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:58.759 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.408+0000 7f3d7f400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8007ad60 0x7f3d8019c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48716/0 (socket says 172.21.15.5:48716) 2024-01-24T15:33:58.759 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.408+0000 7f3d7f400700 1 -- 172.21.15.5:0/701599741 learned_addr learned my addr 172.21.15.5:0/701599741 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:58.759 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.408+0000 7f3d7f400700 1 -- 172.21.15.5:0/701599741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d70009550 con 0x7f3d8007ad60 2024-01-24T15:33:58.759 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.408+0000 7f3d7f400700 1 --2- 172.21.15.5:0/701599741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8007ad60 0x7f3d8019c470 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3d700118f0 tx=0x7f3d700119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:58.759 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.409+0000 7f3d77e00700 1 -- 172.21.15.5:0/701599741 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d700036a0 con 0x7f3d8007ad60 2024-01-24T15:33:58.759 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.409+0000 7f3d77e00700 1 -- 172.21.15.5:0/701599741 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3d7001b440 con 0x7f3d8007ad60 2024-01-24T15:33:58.759 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.409+0000 7f3d77e00700 1 -- 172.21.15.5:0/701599741 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d700193f0 con 0x7f3d8007ad60 2024-01-24T15:33:58.759 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.409+0000 7f3d86600700 1 -- 172.21.15.5:0/701599741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8019cbb0 con 0x7f3d8007ad60 2024-01-24T15:33:58.759 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.409+0000 7f3d86600700 1 -- 172.21.15.5:0/701599741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8019cfd0 con 0x7f3d8007ad60 2024-01-24T15:33:58.759 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.410+0000 7f3d77e00700 1 -- 172.21.15.5:0/701599741 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 8) v1 ==== 45268+0+0 (secure 0 0 0) 0x7f3d7001b5b0 con 0x7f3d8007ad60 2024-01-24T15:33:58.759 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.410+0000 7f3d86600700 1 -- 172.21.15.5:0/701599741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d80062370 con 0x7f3d8007ad60 2024-01-24T15:33:58.759 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.410+0000 7f3d77e00700 1 --2- 172.21.15.5:0/701599741 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f3d60038350 0x7f3d6003a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:58.760 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.410+0000 7f3d77e00700 1 -- 172.21.15.5:0/701599741 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3d7004c0f0 con 0x7f3d8007ad60 2024-01-24T15:33:58.760 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.411+0000 7f3d7ea00700 1 --2- 172.21.15.5:0/701599741 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f3d60038350 0x7f3d6003a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:58.760 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.411+0000 7f3d7ea00700 1 --2- 172.21.15.5:0/701599741 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f3d60038350 0x7f3d6003a810 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3d68006fd0 tx=0x7f3d68006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:58.760 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.420+0000 7f3d77e00700 1 -- 172.21.15.5:0/701599741 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f3d7007f120 con 0x7f3d8007ad60 2024-01-24T15:33:58.760 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:57.705+0000 7f3d86600700 1 -- 172.21.15.5:0/701599741 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f3d801a00e0 con 0x7f3d8007ad60 2024-01-24T15:33:58.760 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:58.385+0000 7f3d77e00700 1 -- 172.21.15.5:0/701599741 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 9) v1 ==== 45281+0+0 (secure 0 0 0) 0x7f3d700039e0 con 0x7f3d8007ad60 2024-01-24T15:33:58.760 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:58.386+0000 7f3d77e00700 1 -- 172.21.15.5:0/701599741 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f3d7000fda0 con 0x7f3d8007ad60 2024-01-24T15:33:58.760 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:58.389+0000 7f3d86600700 1 -- 172.21.15.5:0/701599741 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f3d60038350 msgr2=0x7f3d6003a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:58.760 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:58.389+0000 7f3d86600700 1 --2- 172.21.15.5:0/701599741 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f3d60038350 0x7f3d6003a810 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3d68006fd0 tx=0x7f3d68006e40 comp rx=0 tx=0).stop 2024-01-24T15:33:58.760 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:58.389+0000 7f3d86600700 1 -- 172.21.15.5:0/701599741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8007ad60 msgr2=0x7f3d8019c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:58.760 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:58.389+0000 7f3d86600700 1 --2- 172.21.15.5:0/701599741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8007ad60 0x7f3d8019c470 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3d700118f0 tx=0x7f3d700119d0 comp rx=0 tx=0).stop 2024-01-24T15:33:58.760 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:58.389+0000 7f3d86600700 1 -- 172.21.15.5:0/701599741 shutdown_connections 2024-01-24T15:33:58.761 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:58.389+0000 7f3d86600700 1 --2- 172.21.15.5:0/701599741 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f3d60038350 0x7f3d6003a810 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:58.761 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:58.389+0000 7f3d86600700 1 --2- 172.21.15.5:0/701599741 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3d8007ad60 0x7f3d8019c470 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:58.761 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:58.389+0000 7f3d86600700 1 -- 172.21.15.5:0/701599741 >> 172.21.15.5:0/701599741 conn(0x7f3d80101c00 msgr2=0x7f3d801029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:58.761 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:58.389+0000 7f3d86600700 1 -- 172.21.15.5:0/701599741 shutdown_connections 2024-01-24T15:33:58.761 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:58.389+0000 7f3d86600700 1 -- 172.21.15.5:0/701599741 wait complete. 2024-01-24T15:33:59.024 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:59 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:59.021+0000 7f3ada2e3200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-24T15:33:59.382 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:59 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:59.146+0000 7f3ada2e3200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-24T15:33:59.382 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:59 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:59.266+0000 7f3ada2e3200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-24T15:33:59.382 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:33:59 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:33:59.379+0000 7f3ada2e3200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-24T15:33:59.633 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:59 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/701599741' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-01-24T15:33:59.633 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:33:59 smithi005 ceph-mon[35346]: mgrmap e9: x(active, since 14s) 2024-01-24T15:33:59.778 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-01-24T15:33:59.778 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-01-24T15:33:59.778 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": true, 2024-01-24T15:33:59.778 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-01-24T15:33:59.778 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-01-24T15:33:59.778 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-01-24T15:33:59.778 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.148+0000 7ff64ba00700 1 Processor -- start 2024-01-24T15:33:59.778 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.149+0000 7ff64ba00700 1 -- start start 2024-01-24T15:33:59.778 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.149+0000 7ff64ba00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff644106620 0x7ff644106a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:59.779 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.149+0000 7ff64ba00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff644107010 con 0x7ff644106620 2024-01-24T15:33:59.779 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.149+0000 7ff649000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff644106620 0x7ff644106a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:59.779 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.149+0000 7ff649000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff644106620 0x7ff644106a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48728/0 (socket says 172.21.15.5:48728) 2024-01-24T15:33:59.779 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.149+0000 7ff649000700 1 -- 172.21.15.5:0/3158143260 learned_addr learned my addr 172.21.15.5:0/3158143260 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:59.779 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.150+0000 7ff649000700 1 -- 172.21.15.5:0/3158143260 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff644107820 con 0x7ff644106620 2024-01-24T15:33:59.779 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.150+0000 7ff649000700 1 --2- 172.21.15.5:0/3158143260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff644106620 0x7ff644106a40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff6340098a0 tx=0x7ff634009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf884348b7d4f1d2 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:59.779 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.150+0000 7ff643400700 1 -- 172.21.15.5:0/3158143260 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff634004160 con 0x7ff644106620 2024-01-24T15:33:59.779 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.150+0000 7ff643400700 1 -- 172.21.15.5:0/3158143260 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff6340042c0 con 0x7ff644106620 2024-01-24T15:33:59.779 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.150+0000 7ff643400700 1 -- 172.21.15.5:0/3158143260 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6340118e0 con 0x7ff644106620 2024-01-24T15:33:59.779 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.151+0000 7ff64ba00700 1 -- 172.21.15.5:0/3158143260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff644106620 msgr2=0x7ff644106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:59.780 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.151+0000 7ff64ba00700 1 --2- 172.21.15.5:0/3158143260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff644106620 0x7ff644106a40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff6340098a0 tx=0x7ff634009bb0 comp rx=0 tx=0).stop 2024-01-24T15:33:59.780 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.151+0000 7ff64ba00700 1 -- 172.21.15.5:0/3158143260 shutdown_connections 2024-01-24T15:33:59.780 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.151+0000 7ff64ba00700 1 --2- 172.21.15.5:0/3158143260 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff644106620 0x7ff644106a40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:59.780 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.151+0000 7ff64ba00700 1 -- 172.21.15.5:0/3158143260 >> 172.21.15.5:0/3158143260 conn(0x7ff644101c00 msgr2=0x7ff644104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:59.780 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.151+0000 7ff64ba00700 1 -- 172.21.15.5:0/3158143260 shutdown_connections 2024-01-24T15:33:59.780 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.151+0000 7ff64ba00700 1 -- 172.21.15.5:0/3158143260 wait complete. 2024-01-24T15:33:59.780 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.152+0000 7ff64ba00700 1 Processor -- start 2024-01-24T15:33:59.780 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.153+0000 7ff64ba00700 1 -- start start 2024-01-24T15:33:59.780 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.153+0000 7ff64ba00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff644106620 0x7ff64419c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:59.780 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.153+0000 7ff64ba00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64419ca00 con 0x7ff644106620 2024-01-24T15:33:59.780 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.153+0000 7ff649000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff644106620 0x7ff64419c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:33:59.780 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.153+0000 7ff649000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff644106620 0x7ff64419c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48730/0 (socket says 172.21.15.5:48730) 2024-01-24T15:33:59.781 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.153+0000 7ff649000700 1 -- 172.21.15.5:0/4148719540 learned_addr learned my addr 172.21.15.5:0/4148719540 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:33:59.781 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.154+0000 7ff649000700 1 -- 172.21.15.5:0/4148719540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff634009550 con 0x7ff644106620 2024-01-24T15:33:59.781 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.154+0000 7ff649000700 1 --2- 172.21.15.5:0/4148719540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff644106620 0x7ff64419c4c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff634006af0 tx=0x7ff634011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:33:59.781 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.154+0000 7ff641600700 1 -- 172.21.15.5:0/4148719540 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6340037d0 con 0x7ff644106620 2024-01-24T15:33:59.781 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.154+0000 7ff641600700 1 -- 172.21.15.5:0/4148719540 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff63401b440 con 0x7ff644106620 2024-01-24T15:33:59.781 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.154+0000 7ff641600700 1 -- 172.21.15.5:0/4148719540 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff634019560 con 0x7ff644106620 2024-01-24T15:33:59.781 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.154+0000 7ff64ba00700 1 -- 172.21.15.5:0/4148719540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64419cc00 con 0x7ff644106620 2024-01-24T15:33:59.781 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.154+0000 7ff64ba00700 1 -- 172.21.15.5:0/4148719540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64419d020 con 0x7ff644106620 2024-01-24T15:33:59.781 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.155+0000 7ff641600700 1 -- 172.21.15.5:0/4148719540 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 45281+0+0 (secure 0 0 0) 0x7ff634003930 con 0x7ff644106620 2024-01-24T15:33:59.781 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.156+0000 7ff64ba00700 1 -- 172.21.15.5:0/4148719540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff644062370 con 0x7ff644106620 2024-01-24T15:33:59.781 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.156+0000 7ff641600700 1 --2- 172.21.15.5:0/4148719540 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7ff624038350 0x7ff62403a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:33:59.781 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.156+0000 7ff641600700 1 -- 172.21.15.5:0/4148719540 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff63404c0f0 con 0x7ff644106620 2024-01-24T15:33:59.781 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.156+0000 7ff643e00700 1 -- 172.21.15.5:0/4148719540 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7ff624038350 msgr2=0x7ff62403a810 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/2286807214 2024-01-24T15:33:59.782 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.156+0000 7ff643e00700 1 --2- 172.21.15.5:0/4148719540 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7ff624038350 0x7ff62403a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-24T15:33:59.782 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.161+0000 7ff641600700 1 -- 172.21.15.5:0/4148719540 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7ff63407f120 con 0x7ff644106620 2024-01-24T15:33:59.782 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.357+0000 7ff643e00700 1 -- 172.21.15.5:0/4148719540 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7ff624038350 msgr2=0x7ff62403a810 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/2286807214 2024-01-24T15:33:59.782 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.357+0000 7ff643e00700 1 --2- 172.21.15.5:0/4148719540 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7ff624038350 0x7ff62403a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-24T15:33:59.782 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.428+0000 7ff64ba00700 1 -- 172.21.15.5:0/4148719540 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7ff6441a0110 con 0x7ff644106620 2024-01-24T15:33:59.782 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.429+0000 7ff641600700 1 -- 172.21.15.5:0/4148719540 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7ff63402bb00 con 0x7ff644106620 2024-01-24T15:33:59.782 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.431+0000 7ff64ba00700 1 -- 172.21.15.5:0/4148719540 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7ff624038350 msgr2=0x7ff62403a810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-24T15:33:59.782 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.431+0000 7ff64ba00700 1 --2- 172.21.15.5:0/4148719540 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7ff624038350 0x7ff62403a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:59.782 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.431+0000 7ff64ba00700 1 -- 172.21.15.5:0/4148719540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff644106620 msgr2=0x7ff64419c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:33:59.782 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.431+0000 7ff64ba00700 1 --2- 172.21.15.5:0/4148719540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff644106620 0x7ff64419c4c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff634006af0 tx=0x7ff634011e80 comp rx=0 tx=0).stop 2024-01-24T15:33:59.782 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.431+0000 7ff64ba00700 1 -- 172.21.15.5:0/4148719540 shutdown_connections 2024-01-24T15:33:59.782 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.431+0000 7ff64ba00700 1 --2- 172.21.15.5:0/4148719540 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7ff624038350 0x7ff62403a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:59.782 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.431+0000 7ff64ba00700 1 --2- 172.21.15.5:0/4148719540 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff644106620 0x7ff64419c4c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:33:59.782 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.431+0000 7ff64ba00700 1 -- 172.21.15.5:0/4148719540 >> 172.21.15.5:0/4148719540 conn(0x7ff644101c00 msgr2=0x7ff6441032b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:33:59.782 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.431+0000 7ff64ba00700 1 -- 172.21.15.5:0/4148719540 shutdown_connections 2024-01-24T15:33:59.783 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:33:59.431+0000 7ff64ba00700 1 -- 172.21.15.5:0/4148719540 wait complete. 2024-01-24T15:33:59.783 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for the mgr to restart... 2024-01-24T15:33:59.783 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr epoch 9... 2024-01-24T15:34:00.550 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:00 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/4148719540' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-01-24T15:34:00.550 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:34:00 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:34:00.244+0000 7f3ada2e3200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-24T15:34:00.805 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:34:00 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:34:00.547+0000 7f3ada2e3200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-24T15:34:00.805 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:34:00 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:34:00.661+0000 7f3ada2e3200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-24T15:34:01.178 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:34:00 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:34:00.802+0000 7f3ada2e3200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-24T15:34:01.178 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:34:01 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:34:01.003+0000 7f3ada2e3200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-24T15:34:01.432 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:34:01 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:34:01.176+0000 7f3ada2e3200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-24T15:34:01.433 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:34:01 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:34:01.291+0000 7f3ada2e3200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-24T15:34:02.126 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:34:01 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:34:01.769+0000 7f3ada2e3200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-24T15:34:02.432 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:34:02 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:34:02.123+0000 7f3ada2e3200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-24T15:34:02.932 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:34:02 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:34:02.482+0000 7f3ada2e3200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-24T15:34:02.933 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:34:02 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:34:02.609+0000 7f3ada2e3200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-24T15:34:03.908 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:34:03 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:34:03.580+0000 7f3ada2e3200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-24T15:34:03.908 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:34:03 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:34:03.707+0000 7f3ada2e3200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-24T15:34:04.182 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:34:03 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:34:03.905+0000 7f3ada2e3200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-24T15:34:05.182 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:34:04 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:34:04.743+0000 7f3ada2e3200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-24T15:34:05.183 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:34:04 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:34:04.987+0000 7f3ada2e3200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-24T15:34:05.682 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:34:05 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:34:05.246+0000 7f3ada2e3200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-24T15:34:06.682 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:34:06 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:34:06.401+0000 7f3ada2e3200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-24T15:34:07.142 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:34:06 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:34:06.761+0000 7f3ada2e3200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-24T15:34:07.142 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:34:06 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:34:06.881+0000 7f3ada2e3200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-24T15:34:07.432 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:34:07 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:34:07.139+0000 7f3ada2e3200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-24T15:34:07.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:07 smithi005 ceph-mon[35346]: Active manager daemon x restarted 2024-01-24T15:34:07.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:07 smithi005 ceph-mon[35346]: Activating manager daemon x 2024-01-24T15:34:07.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:07 smithi005 ceph-mon[35346]: osdmap e3: 0 total, 0 up, 0 in 2024-01-24T15:34:07.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:07 smithi005 ceph-mon[35346]: mgrmap e10: x(active, starting, since 0.00386424s) 2024-01-24T15:34:07.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:07 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-24T15:34:07.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:07 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-24T15:34:07.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:07 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-24T15:34:07.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:07 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-24T15:34:07.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:07 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-24T15:34:07.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:07 smithi005 ceph-mon[35346]: Manager daemon x is now available 2024-01-24T15:34:07.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:07 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:34:07.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:07 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:34:08.439 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:08 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-24T15:34:08.439 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:08 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-24T15:34:08.439 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:08 smithi005 ceph-mon[35346]: mgrmap e11: x(active, since 1.00755s) 2024-01-24T15:34:08.569 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-01-24T15:34:08.569 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-01-24T15:34:08.570 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "initialized": true 2024-01-24T15:34:08.570 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-01-24T15:34:08.570 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.206+0000 7f8434600700 1 Processor -- start 2024-01-24T15:34:08.570 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.206+0000 7f8434600700 1 -- start start 2024-01-24T15:34:08.570 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.207+0000 7f8434600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f842c07ad60 0x7f842c0791c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:08.570 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.207+0000 7f8434600700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c079790 con 0x7f842c07ad60 2024-01-24T15:34:08.570 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.207+0000 7f8431c00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f842c07ad60 0x7f842c0791c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:08.570 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.207+0000 7f8431c00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f842c07ad60 0x7f842c0791c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48732/0 (socket says 172.21.15.5:48732) 2024-01-24T15:34:08.570 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.207+0000 7f8431c00700 1 -- 172.21.15.5:0/3292840537 learned_addr learned my addr 172.21.15.5:0/3292840537 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:34:08.570 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.207+0000 7f8431c00700 1 -- 172.21.15.5:0/3292840537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842c0798d0 con 0x7f842c07ad60 2024-01-24T15:34:08.570 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.208+0000 7f8431c00700 1 --2- 172.21.15.5:0/3292840537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f842c07ad60 0x7f842c0791c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f841c0098a0 tx=0x7f841c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c4e9d83098891f server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:08.570 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.208+0000 7f842be00700 1 -- 172.21.15.5:0/3292840537 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f841c004160 con 0x7f842c07ad60 2024-01-24T15:34:08.570 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.208+0000 7f842be00700 1 -- 172.21.15.5:0/3292840537 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f841c0042c0 con 0x7f842c07ad60 2024-01-24T15:34:08.571 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.208+0000 7f842be00700 1 -- 172.21.15.5:0/3292840537 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f841c0118e0 con 0x7f842c07ad60 2024-01-24T15:34:08.571 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.209+0000 7f8434600700 1 -- 172.21.15.5:0/3292840537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f842c07ad60 msgr2=0x7f842c0791c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:08.571 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.209+0000 7f8434600700 1 --2- 172.21.15.5:0/3292840537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f842c07ad60 0x7f842c0791c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f841c0098a0 tx=0x7f841c009bb0 comp rx=0 tx=0).stop 2024-01-24T15:34:08.571 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.209+0000 7f8434600700 1 -- 172.21.15.5:0/3292840537 shutdown_connections 2024-01-24T15:34:08.571 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.209+0000 7f8434600700 1 --2- 172.21.15.5:0/3292840537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f842c07ad60 0x7f842c0791c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:08.571 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.209+0000 7f8434600700 1 -- 172.21.15.5:0/3292840537 >> 172.21.15.5:0/3292840537 conn(0x7f842c101c00 msgr2=0x7f842c104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:08.571 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.209+0000 7f8434600700 1 -- 172.21.15.5:0/3292840537 shutdown_connections 2024-01-24T15:34:08.571 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.209+0000 7f8434600700 1 -- 172.21.15.5:0/3292840537 wait complete. 2024-01-24T15:34:08.571 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.210+0000 7f8434600700 1 Processor -- start 2024-01-24T15:34:08.571 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.210+0000 7f8434600700 1 -- start start 2024-01-24T15:34:08.571 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.210+0000 7f8434600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f842c07ad60 0x7f842c19c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:08.571 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.210+0000 7f8434600700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c19c9b0 con 0x7f842c07ad60 2024-01-24T15:34:08.571 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.210+0000 7f8431c00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f842c07ad60 0x7f842c19c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:08.571 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.211+0000 7f8431c00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f842c07ad60 0x7f842c19c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48744/0 (socket says 172.21.15.5:48744) 2024-01-24T15:34:08.571 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.211+0000 7f8431c00700 1 -- 172.21.15.5:0/1352775693 learned_addr learned my addr 172.21.15.5:0/1352775693 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:34:08.572 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.211+0000 7f8431c00700 1 -- 172.21.15.5:0/1352775693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841c009550 con 0x7f842c07ad60 2024-01-24T15:34:08.572 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.211+0000 7f8431c00700 1 --2- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f842c07ad60 0x7f842c19c470 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f841c0118f0 tx=0x7f841c0119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:08.572 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.211+0000 7f842a000700 1 -- 172.21.15.5:0/1352775693 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f841c0036a0 con 0x7f842c07ad60 2024-01-24T15:34:08.572 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.211+0000 7f842a000700 1 -- 172.21.15.5:0/1352775693 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f841c01b440 con 0x7f842c07ad60 2024-01-24T15:34:08.572 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.211+0000 7f842a000700 1 -- 172.21.15.5:0/1352775693 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f841c0193f0 con 0x7f842c07ad60 2024-01-24T15:34:08.572 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.211+0000 7f8434600700 1 -- 172.21.15.5:0/1352775693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f842c19cbb0 con 0x7f842c07ad60 2024-01-24T15:34:08.572 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.212+0000 7f8434600700 1 -- 172.21.15.5:0/1352775693 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f842c19cfd0 con 0x7f842c07ad60 2024-01-24T15:34:08.572 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.212+0000 7f842a000700 1 -- 172.21.15.5:0/1352775693 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 9) v1 ==== 45281+0+0 (secure 0 0 0) 0x7f841c003800 con 0x7f842c07ad60 2024-01-24T15:34:08.572 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.213+0000 7f842a000700 1 --2- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f840c0383a0 0x7f840c03a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:08.572 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.213+0000 7f8434600700 1 -- 172.21.15.5:0/1352775693 --> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f842c10ca00 con 0x7f840c0383a0 2024-01-24T15:34:08.572 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.213+0000 7f842a000700 1 -- 172.21.15.5:0/1352775693 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f841c04c170 con 0x7f842c07ad60 2024-01-24T15:34:08.572 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.213+0000 7f8431200700 1 -- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f840c0383a0 msgr2=0x7f840c03a860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/2286807214 2024-01-24T15:34:08.572 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.213+0000 7f8431200700 1 --2- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f840c0383a0 0x7f840c03a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-24T15:34:08.573 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.414+0000 7f8431200700 1 -- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f840c0383a0 msgr2=0x7f840c03a860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/2286807214 2024-01-24T15:34:08.573 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.414+0000 7f8431200700 1 --2- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f840c0383a0 0x7f840c03a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-24T15:34:08.573 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.815+0000 7f8431200700 1 -- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f840c0383a0 msgr2=0x7f840c03a860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/2286807214 2024-01-24T15:34:08.573 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:00.815+0000 7f8431200700 1 --2- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f840c0383a0 0x7f840c03a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-24T15:34:08.573 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:01.616+0000 7f8431200700 1 -- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f840c0383a0 msgr2=0x7f840c03a860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/2286807214 2024-01-24T15:34:08.573 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:01.616+0000 7f8431200700 1 --2- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f840c0383a0 0x7f840c03a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-24T15:34:08.573 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:03.217+0000 7f8431200700 1 -- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f840c0383a0 msgr2=0x7f840c03a860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/2286807214 2024-01-24T15:34:08.573 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:03.217+0000 7f8431200700 1 --2- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f840c0383a0 0x7f840c03a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-01-24T15:34:08.573 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:06.421+0000 7f8431200700 1 -- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f840c0383a0 msgr2=0x7f840c03a860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.5:6800/2286807214 2024-01-24T15:34:08.573 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:06.421+0000 7f8431200700 1 --2- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f840c0383a0 0x7f840c03a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-01-24T15:34:08.573 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:07.145+0000 7f842a000700 1 -- 172.21.15.5:0/1352775693 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mgrmap(e 10) v1 ==== 45048+0+0 (secure 0 0 0) 0x7f841c00fda0 con 0x7f842c07ad60 2024-01-24T15:34:08.573 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:07.145+0000 7f842a000700 1 -- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f840c0383a0 msgr2=0x7f840c03a860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-24T15:34:08.573 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:07.145+0000 7f842a000700 1 --2- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f840c0383a0 0x7f840c03a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:08.573 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:08.147+0000 7f842a000700 1 -- 172.21.15.5:0/1352775693 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 11) v1 ==== 45175+0+0 (secure 0 0 0) 0x7f841c04dde0 con 0x7f842c07ad60 2024-01-24T15:34:08.574 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:08.147+0000 7f842a000700 1 --2- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f840c03bc60 0x7f840c03e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:08.574 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:08.147+0000 7f842a000700 1 -- 172.21.15.5:0/1352775693 --> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f842c10ca00 con 0x7f840c03bc60 2024-01-24T15:34:08.574 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:08.148+0000 7f8431200700 1 --2- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f840c03bc60 0x7f840c03e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:08.574 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:08.149+0000 7f8431200700 1 --2- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f840c03bc60 0x7f840c03e050 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8414003a10 tx=0x7f8414009270 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:08.574 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:08.150+0000 7f842a000700 1 -- 172.21.15.5:0/1352775693 <== mgr.14150 v2:172.21.15.5:6800/1971309753 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f842c10ca00 con 0x7f840c03bc60 2024-01-24T15:34:08.574 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:08.160+0000 7f8434600700 1 -- 172.21.15.5:0/1352775693 --> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f842c19d7b0 con 0x7f840c03bc60 2024-01-24T15:34:08.574 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:08.160+0000 7f842a000700 1 -- 172.21.15.5:0/1352775693 <== mgr.14150 v2:172.21.15.5:6800/1971309753 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f842c19d7b0 con 0x7f840c03bc60 2024-01-24T15:34:08.574 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:08.161+0000 7f8434600700 1 -- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f840c03bc60 msgr2=0x7f840c03e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:08.574 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:08.161+0000 7f8434600700 1 --2- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f840c03bc60 0x7f840c03e050 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8414003a10 tx=0x7f8414009270 comp rx=0 tx=0).stop 2024-01-24T15:34:08.574 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:08.161+0000 7f8434600700 1 -- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f842c07ad60 msgr2=0x7f842c19c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:08.574 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:08.161+0000 7f8434600700 1 --2- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f842c07ad60 0x7f842c19c470 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f841c0118f0 tx=0x7f841c0119d0 comp rx=0 tx=0).stop 2024-01-24T15:34:08.574 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:08.161+0000 7f8434600700 1 -- 172.21.15.5:0/1352775693 shutdown_connections 2024-01-24T15:34:08.574 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:08.161+0000 7f8434600700 1 --2- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f840c03bc60 0x7f840c03e050 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:08.574 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:08.161+0000 7f8434600700 1 --2- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f842c07ad60 0x7f842c19c470 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:08.575 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:08.161+0000 7f8434600700 1 --2- 172.21.15.5:0/1352775693 >> [v2:172.21.15.5:6800/2286807214,v1:172.21.15.5:6801/2286807214] conn(0x7f840c0383a0 0x7f840c03a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:08.575 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:08.161+0000 7f8434600700 1 -- 172.21.15.5:0/1352775693 >> 172.21.15.5:0/1352775693 conn(0x7f842c101c00 msgr2=0x7f842c1029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:08.575 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:08.161+0000 7f8434600700 1 -- 172.21.15.5:0/1352775693 shutdown_connections 2024-01-24T15:34:08.575 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:08.161+0000 7f8434600700 1 -- 172.21.15.5:0/1352775693 wait complete. 2024-01-24T15:34:08.575 INFO:teuthology.orchestra.run.smithi005.stdout:mgr epoch 9 is available 2024-01-24T15:34:08.575 INFO:teuthology.orchestra.run.smithi005.stdout:Generating a dashboard self-signed certificate... 2024-01-24T15:34:09.635 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-01-24T15:34:09.635 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.042+0000 7f87b0a00700 1 Processor -- start 2024-01-24T15:34:09.635 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.042+0000 7f87b0a00700 1 -- start start 2024-01-24T15:34:09.635 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.043+0000 7f87b0a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87a8107110 0x7f87a8109500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:09.635 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.043+0000 7f87b0a00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a80744a0 con 0x7f87a8107110 2024-01-24T15:34:09.635 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.043+0000 7f87ae000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87a8107110 0x7f87a8109500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:09.635 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.043+0000 7f87ae000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87a8107110 0x7f87a8109500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60378/0 (socket says 172.21.15.5:60378) 2024-01-24T15:34:09.635 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.043+0000 7f87ae000700 1 -- 172.21.15.5:0/4141161013 learned_addr learned my addr 172.21.15.5:0/4141161013 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:34:09.635 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.043+0000 7f87ae000700 1 -- 172.21.15.5:0/4141161013 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a8109a40 con 0x7f87a8107110 2024-01-24T15:34:09.635 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.043+0000 7f87ae000700 1 --2- 172.21.15.5:0/4141161013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87a8107110 0x7f87a8109500 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f87980098a0 tx=0x7f8798009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d85b9fc970d56d server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:09.635 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.044+0000 7f87acc00700 1 -- 172.21.15.5:0/4141161013 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8798004160 con 0x7f87a8107110 2024-01-24T15:34:09.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.044+0000 7f87acc00700 1 -- 172.21.15.5:0/4141161013 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f87980042c0 con 0x7f87a8107110 2024-01-24T15:34:09.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.044+0000 7f87acc00700 1 -- 172.21.15.5:0/4141161013 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87980118e0 con 0x7f87a8107110 2024-01-24T15:34:09.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.044+0000 7f87b0a00700 1 -- 172.21.15.5:0/4141161013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87a8107110 msgr2=0x7f87a8109500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:09.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.044+0000 7f87b0a00700 1 --2- 172.21.15.5:0/4141161013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87a8107110 0x7f87a8109500 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f87980098a0 tx=0x7f8798009bb0 comp rx=0 tx=0).stop 2024-01-24T15:34:09.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.044+0000 7f87b0a00700 1 -- 172.21.15.5:0/4141161013 shutdown_connections 2024-01-24T15:34:09.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.044+0000 7f87b0a00700 1 --2- 172.21.15.5:0/4141161013 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87a8107110 0x7f87a8109500 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:09.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.044+0000 7f87b0a00700 1 -- 172.21.15.5:0/4141161013 >> 172.21.15.5:0/4141161013 conn(0x7f87a8100b20 msgr2=0x7f87a8102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:09.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.045+0000 7f87b0a00700 1 -- 172.21.15.5:0/4141161013 shutdown_connections 2024-01-24T15:34:09.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.045+0000 7f87b0a00700 1 -- 172.21.15.5:0/4141161013 wait complete. 2024-01-24T15:34:09.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.046+0000 7f87b0a00700 1 Processor -- start 2024-01-24T15:34:09.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.046+0000 7f87b0a00700 1 -- start start 2024-01-24T15:34:09.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.046+0000 7f87b0a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87a8107110 0x7f87a819c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:09.636 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.046+0000 7f87b0a00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a819c9a0 con 0x7f87a8107110 2024-01-24T15:34:09.637 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.046+0000 7f87ae000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87a8107110 0x7f87a819c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:09.637 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.046+0000 7f87ae000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87a8107110 0x7f87a819c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60384/0 (socket says 172.21.15.5:60384) 2024-01-24T15:34:09.637 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.046+0000 7f87ae000700 1 -- 172.21.15.5:0/381643590 learned_addr learned my addr 172.21.15.5:0/381643590 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:34:09.637 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.047+0000 7f87ae000700 1 -- 172.21.15.5:0/381643590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8798009550 con 0x7f87a8107110 2024-01-24T15:34:09.637 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.047+0000 7f87ae000700 1 --2- 172.21.15.5:0/381643590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87a8107110 0x7f87a819c460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f87980118f0 tx=0x7f87980119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:09.637 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.047+0000 7f87a6a00700 1 -- 172.21.15.5:0/381643590 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87980036a0 con 0x7f87a8107110 2024-01-24T15:34:09.637 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.047+0000 7f87a6a00700 1 -- 172.21.15.5:0/381643590 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f879801b440 con 0x7f87a8107110 2024-01-24T15:34:09.637 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.047+0000 7f87a6a00700 1 -- 172.21.15.5:0/381643590 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87980193f0 con 0x7f87a8107110 2024-01-24T15:34:09.637 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.047+0000 7f87b0a00700 1 -- 172.21.15.5:0/381643590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a819cba0 con 0x7f87a8107110 2024-01-24T15:34:09.637 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.047+0000 7f87b0a00700 1 -- 172.21.15.5:0/381643590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a819cfc0 con 0x7f87a8107110 2024-01-24T15:34:09.637 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.048+0000 7f87a6a00700 1 -- 172.21.15.5:0/381643590 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 11) v1 ==== 45175+0+0 (secure 0 0 0) 0x7f879801b5b0 con 0x7f87a8107110 2024-01-24T15:34:09.637 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.048+0000 7f87b0a00700 1 -- 172.21.15.5:0/381643590 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87a8062370 con 0x7f87a8107110 2024-01-24T15:34:09.637 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.049+0000 7f87a6a00700 1 --2- 172.21.15.5:0/381643590 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f8788038270 0x7f878803a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:09.638 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.049+0000 7f87a6a00700 1 -- 172.21.15.5:0/381643590 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f879804c040 con 0x7f87a8107110 2024-01-24T15:34:09.638 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.049+0000 7f87ad600700 1 --2- 172.21.15.5:0/381643590 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f8788038270 0x7f878803a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:09.638 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.050+0000 7f87ad600700 1 --2- 172.21.15.5:0/381643590 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f8788038270 0x7f878803a730 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8790006fd0 tx=0x7f8790006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:09.638 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.054+0000 7f87a6a00700 1 -- 172.21.15.5:0/381643590 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f8798023a00 con 0x7f87a8107110 2024-01-24T15:34:09.638 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.271+0000 7f87b0a00700 1 -- 172.21.15.5:0/381643590 --> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f87a8101fd0 con 0x7f8788038270 2024-01-24T15:34:09.638 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.308+0000 7f87a6a00700 1 -- 172.21.15.5:0/381643590 <== mgr.14150 v2:172.21.15.5:6800/1971309753 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f87a8101fd0 con 0x7f8788038270 2024-01-24T15:34:09.638 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.310+0000 7f87b0a00700 1 -- 172.21.15.5:0/381643590 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f8788038270 msgr2=0x7f878803a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:09.638 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.310+0000 7f87b0a00700 1 --2- 172.21.15.5:0/381643590 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f8788038270 0x7f878803a730 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8790006fd0 tx=0x7f8790006e40 comp rx=0 tx=0).stop 2024-01-24T15:34:09.638 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.310+0000 7f87b0a00700 1 -- 172.21.15.5:0/381643590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87a8107110 msgr2=0x7f87a819c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:09.638 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.310+0000 7f87b0a00700 1 --2- 172.21.15.5:0/381643590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87a8107110 0x7f87a819c460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f87980118f0 tx=0x7f87980119d0 comp rx=0 tx=0).stop 2024-01-24T15:34:09.638 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.311+0000 7f87b0a00700 1 -- 172.21.15.5:0/381643590 shutdown_connections 2024-01-24T15:34:09.638 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.311+0000 7f87b0a00700 1 --2- 172.21.15.5:0/381643590 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f8788038270 0x7f878803a730 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:09.638 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.311+0000 7f87b0a00700 1 --2- 172.21.15.5:0/381643590 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f87a8107110 0x7f87a819c460 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:09.639 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.311+0000 7f87b0a00700 1 -- 172.21.15.5:0/381643590 >> 172.21.15.5:0/381643590 conn(0x7f87a8100b20 msgr2=0x7f87a81018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:09.639 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.311+0000 7f87b0a00700 1 -- 172.21.15.5:0/381643590 shutdown_connections 2024-01-24T15:34:09.639 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:09.311+0000 7f87b0a00700 1 -- 172.21.15.5:0/381643590 wait complete. 2024-01-24T15:34:09.639 INFO:teuthology.orchestra.run.smithi005.stdout:Creating initial admin user... 2024-01-24T15:34:09.639 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:09 smithi005 ceph-mon[35346]: [24/Jan/2024:15:34:07] ENGINE Bus STARTING 2024-01-24T15:34:09.639 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:09 smithi005 ceph-mon[35346]: [24/Jan/2024:15:34:07] ENGINE Serving on https://172.21.15.5:7150 2024-01-24T15:34:09.639 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:09 smithi005 ceph-mon[35346]: [24/Jan/2024:15:34:07] ENGINE Serving on http://172.21.15.5:8765 2024-01-24T15:34:09.639 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:09 smithi005 ceph-mon[35346]: [24/Jan/2024:15:34:07] ENGINE Bus STARTED 2024-01-24T15:34:09.639 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:09 smithi005 ceph-mon[35346]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-01-24T15:34:09.639 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:09 smithi005 ceph-mon[35346]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-01-24T15:34:09.640 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:09 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:09.640 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:09 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:09.640 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:09 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:10.589 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:10 smithi005 ceph-mon[35346]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:34:10.589 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:10 smithi005 ceph-mon[35346]: mgrmap e12: x(active, since 2s) 2024-01-24T15:34:10.589 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:10 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:11.034 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$1xJmUBOD9y.WCjh9gxc4suoVCYzWZIVqoSCwuZQBS5cIIKbdFz4a.", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1706110450, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-01-24T15:34:11.034 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.046+0000 7f9563200700 1 Processor -- start 2024-01-24T15:34:11.034 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.046+0000 7f9563200700 1 -- start start 2024-01-24T15:34:11.034 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.047+0000 7f9563200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f955c108870 0x7f955c108c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:11.034 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.047+0000 7f9563200700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955c109260 con 0x7f955c108870 2024-01-24T15:34:11.034 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.047+0000 7f955be00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f955c108870 0x7f955c108c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:11.034 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.047+0000 7f955be00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f955c108870 0x7f955c108c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60398/0 (socket says 172.21.15.5:60398) 2024-01-24T15:34:11.034 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.047+0000 7f955be00700 1 -- 172.21.15.5:0/3928038334 learned_addr learned my addr 172.21.15.5:0/3928038334 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:34:11.034 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.048+0000 7f955be00700 1 -- 172.21.15.5:0/3928038334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955c109a20 con 0x7f955c108870 2024-01-24T15:34:11.034 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.048+0000 7f955be00700 1 --2- 172.21.15.5:0/3928038334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f955c108870 0x7f955c108c90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f954c0098a0 tx=0x7f954c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63e09f26d09c651 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:11.034 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.048+0000 7f955aa00700 1 -- 172.21.15.5:0/3928038334 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f954c004160 con 0x7f955c108870 2024-01-24T15:34:11.035 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.048+0000 7f955aa00700 1 -- 172.21.15.5:0/3928038334 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f954c0042c0 con 0x7f955c108870 2024-01-24T15:34:11.035 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.048+0000 7f955aa00700 1 -- 172.21.15.5:0/3928038334 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f954c0118e0 con 0x7f955c108870 2024-01-24T15:34:11.035 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.049+0000 7f9563200700 1 -- 172.21.15.5:0/3928038334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f955c108870 msgr2=0x7f955c108c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:11.035 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.049+0000 7f9563200700 1 --2- 172.21.15.5:0/3928038334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f955c108870 0x7f955c108c90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f954c0098a0 tx=0x7f954c009bb0 comp rx=0 tx=0).stop 2024-01-24T15:34:11.035 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.049+0000 7f9563200700 1 -- 172.21.15.5:0/3928038334 shutdown_connections 2024-01-24T15:34:11.035 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.049+0000 7f9563200700 1 --2- 172.21.15.5:0/3928038334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f955c108870 0x7f955c108c90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:11.035 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.049+0000 7f9563200700 1 -- 172.21.15.5:0/3928038334 >> 172.21.15.5:0/3928038334 conn(0x7f955c07bde0 msgr2=0x7f955c1064c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:11.035 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.049+0000 7f9563200700 1 -- 172.21.15.5:0/3928038334 shutdown_connections 2024-01-24T15:34:11.035 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.049+0000 7f9563200700 1 -- 172.21.15.5:0/3928038334 wait complete. 2024-01-24T15:34:11.035 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.050+0000 7f9563200700 1 Processor -- start 2024-01-24T15:34:11.035 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.050+0000 7f9563200700 1 -- start start 2024-01-24T15:34:11.035 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.051+0000 7f9563200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f955c108870 0x7f955c07fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:11.035 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.051+0000 7f9563200700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955c080190 con 0x7f955c108870 2024-01-24T15:34:11.035 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.051+0000 7f955be00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f955c108870 0x7f955c07fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:11.036 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.051+0000 7f955be00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f955c108870 0x7f955c07fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60414/0 (socket says 172.21.15.5:60414) 2024-01-24T15:34:11.036 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.051+0000 7f955be00700 1 -- 172.21.15.5:0/1957794197 learned_addr learned my addr 172.21.15.5:0/1957794197 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:34:11.036 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.051+0000 7f955be00700 1 -- 172.21.15.5:0/1957794197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954c009550 con 0x7f955c108870 2024-01-24T15:34:11.036 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.051+0000 7f955be00700 1 --2- 172.21.15.5:0/1957794197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f955c108870 0x7f955c07fc50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f954c000c00 tx=0x7f954c0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:11.036 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.052+0000 7f9558c00700 1 -- 172.21.15.5:0/1957794197 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f954c0036a0 con 0x7f955c108870 2024-01-24T15:34:11.036 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.052+0000 7f9558c00700 1 -- 172.21.15.5:0/1957794197 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f954c01b440 con 0x7f955c108870 2024-01-24T15:34:11.036 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.052+0000 7f9563200700 1 -- 172.21.15.5:0/1957794197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f955c080390 con 0x7f955c108870 2024-01-24T15:34:11.036 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.052+0000 7f9558c00700 1 -- 172.21.15.5:0/1957794197 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f954c01a3d0 con 0x7f955c108870 2024-01-24T15:34:11.036 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.052+0000 7f9563200700 1 -- 172.21.15.5:0/1957794197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f955c07c880 con 0x7f955c108870 2024-01-24T15:34:11.036 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.053+0000 7f9558c00700 1 -- 172.21.15.5:0/1957794197 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 45281+0+0 (secure 0 0 0) 0x7f954c01b5b0 con 0x7f955c108870 2024-01-24T15:34:11.036 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.053+0000 7f9563200700 1 -- 172.21.15.5:0/1957794197 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f955c080520 con 0x7f955c108870 2024-01-24T15:34:11.036 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.053+0000 7f9558c00700 1 --2- 172.21.15.5:0/1957794197 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f953c038350 0x7f953c03a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:11.036 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.054+0000 7f9558c00700 1 -- 172.21.15.5:0/1957794197 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f954c04c1b0 con 0x7f955c108870 2024-01-24T15:34:11.037 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.054+0000 7f955b400700 1 --2- 172.21.15.5:0/1957794197 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f953c038350 0x7f953c03a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:11.037 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.054+0000 7f955b400700 1 --2- 172.21.15.5:0/1957794197 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f953c038350 0x7f953c03a810 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9544006fd0 tx=0x7f9544006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:11.037 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.062+0000 7f9558c00700 1 -- 172.21.15.5:0/1957794197 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f954c023be0 con 0x7f955c108870 2024-01-24T15:34:11.037 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.314+0000 7f9563200700 1 -- 172.21.15.5:0/1957794197 --> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f955c062190 con 0x7f953c038350 2024-01-24T15:34:11.037 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.562+0000 7f9558c00700 1 -- 172.21.15.5:0/1957794197 <== mgr.14150 v2:172.21.15.5:6800/1971309753 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f955c062190 con 0x7f953c038350 2024-01-24T15:34:11.037 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.565+0000 7f9563200700 1 -- 172.21.15.5:0/1957794197 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f953c038350 msgr2=0x7f953c03a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:11.037 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.565+0000 7f9563200700 1 --2- 172.21.15.5:0/1957794197 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f953c038350 0x7f953c03a810 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9544006fd0 tx=0x7f9544006e40 comp rx=0 tx=0).stop 2024-01-24T15:34:11.037 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.565+0000 7f9563200700 1 -- 172.21.15.5:0/1957794197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f955c108870 msgr2=0x7f955c07fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:11.037 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.565+0000 7f9563200700 1 --2- 172.21.15.5:0/1957794197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f955c108870 0x7f955c07fc50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f954c000c00 tx=0x7f954c0119a0 comp rx=0 tx=0).stop 2024-01-24T15:34:11.037 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.565+0000 7f9563200700 1 -- 172.21.15.5:0/1957794197 shutdown_connections 2024-01-24T15:34:11.037 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.565+0000 7f9563200700 1 --2- 172.21.15.5:0/1957794197 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f953c038350 0x7f953c03a810 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:11.037 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.565+0000 7f9563200700 1 --2- 172.21.15.5:0/1957794197 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f955c108870 0x7f955c07fc50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:11.037 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.565+0000 7f9563200700 1 -- 172.21.15.5:0/1957794197 >> 172.21.15.5:0/1957794197 conn(0x7f955c07bde0 msgr2=0x7f955c105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:11.038 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.565+0000 7f9563200700 1 -- 172.21.15.5:0/1957794197 shutdown_connections 2024-01-24T15:34:11.038 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:10.565+0000 7f9563200700 1 -- 172.21.15.5:0/1957794197 wait complete. 2024-01-24T15:34:11.038 INFO:teuthology.orchestra.run.smithi005.stdout:Fetching dashboard port number... 2024-01-24T15:34:11.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:11 smithi005 ceph-mon[35346]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:34:11.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:11.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 8443 2024-01-24T15:34:11.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.421+0000 7f4deb800700 1 Processor -- start 2024-01-24T15:34:11.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.421+0000 7f4deb800700 1 -- start start 2024-01-24T15:34:11.971 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.421+0000 7f4deb800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de4106620 0x7f4de4106a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:11.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.421+0000 7f4deb800700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de4107010 con 0x7f4de4106620 2024-01-24T15:34:11.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.422+0000 7f4de8e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de4106620 0x7f4de4106a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:11.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.422+0000 7f4de8e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de4106620 0x7f4de4106a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60428/0 (socket says 172.21.15.5:60428) 2024-01-24T15:34:11.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.422+0000 7f4de8e00700 1 -- 172.21.15.5:0/3245756635 learned_addr learned my addr 172.21.15.5:0/3245756635 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:34:11.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.422+0000 7f4de8e00700 1 -- 172.21.15.5:0/3245756635 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de4107820 con 0x7f4de4106620 2024-01-24T15:34:11.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.423+0000 7f4de8e00700 1 --2- 172.21.15.5:0/3245756635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de4106620 0x7f4de4106a40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40098a0 tx=0x7f4dd4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4300c25cc4923 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:11.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.423+0000 7f4de3400700 1 -- 172.21.15.5:0/3245756635 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dd4004160 con 0x7f4de4106620 2024-01-24T15:34:11.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.423+0000 7f4de3400700 1 -- 172.21.15.5:0/3245756635 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4dd40042c0 con 0x7f4de4106620 2024-01-24T15:34:11.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.423+0000 7f4de3400700 1 -- 172.21.15.5:0/3245756635 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dd40118e0 con 0x7f4de4106620 2024-01-24T15:34:11.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.423+0000 7f4deb800700 1 -- 172.21.15.5:0/3245756635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de4106620 msgr2=0x7f4de4106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:11.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.423+0000 7f4deb800700 1 --2- 172.21.15.5:0/3245756635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de4106620 0x7f4de4106a40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40098a0 tx=0x7f4dd4009bb0 comp rx=0 tx=0).stop 2024-01-24T15:34:11.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.423+0000 7f4deb800700 1 -- 172.21.15.5:0/3245756635 shutdown_connections 2024-01-24T15:34:11.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.423+0000 7f4deb800700 1 --2- 172.21.15.5:0/3245756635 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de4106620 0x7f4de4106a40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:11.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.424+0000 7f4deb800700 1 -- 172.21.15.5:0/3245756635 >> 172.21.15.5:0/3245756635 conn(0x7f4de4101c00 msgr2=0x7f4de4104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:11.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.424+0000 7f4deb800700 1 -- 172.21.15.5:0/3245756635 shutdown_connections 2024-01-24T15:34:11.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.424+0000 7f4deb800700 1 -- 172.21.15.5:0/3245756635 wait complete. 2024-01-24T15:34:11.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.425+0000 7f4deb800700 1 Processor -- start 2024-01-24T15:34:11.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.425+0000 7f4deb800700 1 -- start start 2024-01-24T15:34:11.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.425+0000 7f4deb800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de4106620 0x7f4de407ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:11.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.425+0000 7f4deb800700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de407b070 con 0x7f4de4106620 2024-01-24T15:34:11.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.425+0000 7f4de8e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de4106620 0x7f4de407ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:11.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.425+0000 7f4de8e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de4106620 0x7f4de407ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60440/0 (socket says 172.21.15.5:60440) 2024-01-24T15:34:11.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.425+0000 7f4de8e00700 1 -- 172.21.15.5:0/954838277 learned_addr learned my addr 172.21.15.5:0/954838277 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:34:11.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.426+0000 7f4de8e00700 1 -- 172.21.15.5:0/954838277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd4009550 con 0x7f4de4106620 2024-01-24T15:34:11.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.426+0000 7f4de8e00700 1 --2- 172.21.15.5:0/954838277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de4106620 0x7f4de407ab30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4006af0 tx=0x7f4dd4011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:11.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.426+0000 7f4de1600700 1 -- 172.21.15.5:0/954838277 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dd40037d0 con 0x7f4de4106620 2024-01-24T15:34:11.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.426+0000 7f4de1600700 1 -- 172.21.15.5:0/954838277 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4dd401b440 con 0x7f4de4106620 2024-01-24T15:34:11.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.426+0000 7f4de1600700 1 -- 172.21.15.5:0/954838277 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4dd4019560 con 0x7f4de4106620 2024-01-24T15:34:11.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.426+0000 7f4deb800700 1 -- 172.21.15.5:0/954838277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de4079180 con 0x7f4de4106620 2024-01-24T15:34:11.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.426+0000 7f4deb800700 1 -- 172.21.15.5:0/954838277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de40795a0 con 0x7f4de4106620 2024-01-24T15:34:11.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.427+0000 7f4de1600700 1 -- 172.21.15.5:0/954838277 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 45281+0+0 (secure 0 0 0) 0x7f4dd4003930 con 0x7f4de4106620 2024-01-24T15:34:11.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.427+0000 7f4deb800700 1 -- 172.21.15.5:0/954838277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de4062370 con 0x7f4de4106620 2024-01-24T15:34:11.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.428+0000 7f4de1600700 1 --2- 172.21.15.5:0/954838277 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f4dc4038350 0x7f4dc403a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:11.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.428+0000 7f4de1600700 1 -- 172.21.15.5:0/954838277 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4dd404c110 con 0x7f4de4106620 2024-01-24T15:34:11.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.428+0000 7f4de3e00700 1 --2- 172.21.15.5:0/954838277 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f4dc4038350 0x7f4dc403a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:11.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.429+0000 7f4de3e00700 1 --2- 172.21.15.5:0/954838277 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f4dc4038350 0x7f4dc403a810 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc006fd0 tx=0x7f4dcc006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:11.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.432+0000 7f4de1600700 1 -- 172.21.15.5:0/954838277 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f4dd402bb00 con 0x7f4de4106620 2024-01-24T15:34:11.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.643+0000 7f4deb800700 1 -- 172.21.15.5:0/954838277 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f4de4079d60 con 0x7f4de4106620 2024-01-24T15:34:11.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.643+0000 7f4de1600700 1 -- 172.21.15.5:0/954838277 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f4dd402bb00 con 0x7f4de4106620 2024-01-24T15:34:11.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.645+0000 7f4deb800700 1 -- 172.21.15.5:0/954838277 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f4dc4038350 msgr2=0x7f4dc403a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:11.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.645+0000 7f4deb800700 1 --2- 172.21.15.5:0/954838277 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f4dc4038350 0x7f4dc403a810 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc006fd0 tx=0x7f4dcc006e40 comp rx=0 tx=0).stop 2024-01-24T15:34:11.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.645+0000 7f4deb800700 1 -- 172.21.15.5:0/954838277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de4106620 msgr2=0x7f4de407ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:11.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.645+0000 7f4deb800700 1 --2- 172.21.15.5:0/954838277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de4106620 0x7f4de407ab30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4006af0 tx=0x7f4dd4011e80 comp rx=0 tx=0).stop 2024-01-24T15:34:11.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.646+0000 7f4deb800700 1 -- 172.21.15.5:0/954838277 shutdown_connections 2024-01-24T15:34:11.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.646+0000 7f4deb800700 1 --2- 172.21.15.5:0/954838277 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f4dc4038350 0x7f4dc403a810 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:11.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.646+0000 7f4deb800700 1 --2- 172.21.15.5:0/954838277 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4de4106620 0x7f4de407ab30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:11.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.646+0000 7f4deb800700 1 -- 172.21.15.5:0/954838277 >> 172.21.15.5:0/954838277 conn(0x7f4de4101c00 msgr2=0x7f4de41032b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:11.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.646+0000 7f4deb800700 1 -- 172.21.15.5:0/954838277 shutdown_connections 2024-01-24T15:34:11.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:11.646+0000 7f4deb800700 1 -- 172.21.15.5:0/954838277 wait complete. 2024-01-24T15:34:11.987 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-01-24T15:34:11.987 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2024-01-24T15:34:12.002 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-01-24T15:34:12.002 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-01-24T15:34:12.002 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2024-01-24T15:34:12.002 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-01-24T15:34:12.004 INFO:teuthology.orchestra.run.smithi005.stdout:Ceph Dashboard is now available at: 2024-01-24T15:34:12.004 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:34:12.004 INFO:teuthology.orchestra.run.smithi005.stdout: URL: https://smithi005.front.sepia.ceph.com:8443/ 2024-01-24T15:34:12.005 INFO:teuthology.orchestra.run.smithi005.stdout: User: admin 2024-01-24T15:34:12.005 INFO:teuthology.orchestra.run.smithi005.stdout: Password: f8bm3wdxr7 2024-01-24T15:34:12.005 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:34:12.005 INFO:teuthology.orchestra.run.smithi005.stdout:Saving cluster configuration to /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/config directory 2024-01-24T15:34:12.006 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling autotune for osd_memory_target 2024-01-24T15:34:12.817 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:12 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/954838277' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-01-24T15:34:12.972 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.400+0000 7ff03a800700 1 Processor -- start 2024-01-24T15:34:12.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.400+0000 7ff03a800700 1 -- start start 2024-01-24T15:34:12.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.400+0000 7ff03a800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff034106620 0x7ff034106a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:12.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.400+0000 7ff03a800700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff034107010 con 0x7ff034106620 2024-01-24T15:34:12.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.401+0000 7ff033400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff034106620 0x7ff034106a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:12.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.401+0000 7ff033400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff034106620 0x7ff034106a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48242/0 (socket says 172.21.15.5:48242) 2024-01-24T15:34:12.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.401+0000 7ff033400700 1 -- 172.21.15.5:0/3467404453 learned_addr learned my addr 172.21.15.5:0/3467404453 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:34:12.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.401+0000 7ff033400700 1 -- 172.21.15.5:0/3467404453 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff034107820 con 0x7ff034106620 2024-01-24T15:34:12.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.401+0000 7ff033400700 1 --2- 172.21.15.5:0/3467404453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff034106620 0x7ff034106a40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff0240098a0 tx=0x7ff024009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab740d87f29f253 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:12.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.402+0000 7ff032000700 1 -- 172.21.15.5:0/3467404453 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff024004160 con 0x7ff034106620 2024-01-24T15:34:12.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.402+0000 7ff032000700 1 -- 172.21.15.5:0/3467404453 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0240042c0 con 0x7ff034106620 2024-01-24T15:34:12.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.402+0000 7ff032000700 1 -- 172.21.15.5:0/3467404453 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0240118e0 con 0x7ff034106620 2024-01-24T15:34:12.973 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.402+0000 7ff03a800700 1 -- 172.21.15.5:0/3467404453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff034106620 msgr2=0x7ff034106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:12.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.402+0000 7ff03a800700 1 --2- 172.21.15.5:0/3467404453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff034106620 0x7ff034106a40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff0240098a0 tx=0x7ff024009bb0 comp rx=0 tx=0).stop 2024-01-24T15:34:12.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.402+0000 7ff03a800700 1 -- 172.21.15.5:0/3467404453 shutdown_connections 2024-01-24T15:34:12.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.402+0000 7ff03a800700 1 --2- 172.21.15.5:0/3467404453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff034106620 0x7ff034106a40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:12.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.402+0000 7ff03a800700 1 -- 172.21.15.5:0/3467404453 >> 172.21.15.5:0/3467404453 conn(0x7ff034101c00 msgr2=0x7ff034104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:12.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.403+0000 7ff03a800700 1 -- 172.21.15.5:0/3467404453 shutdown_connections 2024-01-24T15:34:12.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.403+0000 7ff03a800700 1 -- 172.21.15.5:0/3467404453 wait complete. 2024-01-24T15:34:12.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.404+0000 7ff03a800700 1 Processor -- start 2024-01-24T15:34:12.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.404+0000 7ff03a800700 1 -- start start 2024-01-24T15:34:12.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.405+0000 7ff03a800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff034106620 0x7ff03419c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:12.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.405+0000 7ff03a800700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03419c9e0 con 0x7ff034106620 2024-01-24T15:34:12.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.405+0000 7ff033400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff034106620 0x7ff03419c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:12.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.405+0000 7ff033400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff034106620 0x7ff03419c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48244/0 (socket says 172.21.15.5:48244) 2024-01-24T15:34:12.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.405+0000 7ff033400700 1 -- 172.21.15.5:0/3961496096 learned_addr learned my addr 172.21.15.5:0/3961496096 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:34:12.974 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.405+0000 7ff033400700 1 -- 172.21.15.5:0/3961496096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff024009550 con 0x7ff034106620 2024-01-24T15:34:12.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.406+0000 7ff033400700 1 --2- 172.21.15.5:0/3961496096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff034106620 0x7ff03419c4a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff024000c00 tx=0x7ff0240119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:12.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.406+0000 7ff02be00700 1 -- 172.21.15.5:0/3961496096 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0240036a0 con 0x7ff034106620 2024-01-24T15:34:12.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.406+0000 7ff03a800700 1 -- 172.21.15.5:0/3961496096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff03419cbe0 con 0x7ff034106620 2024-01-24T15:34:12.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.406+0000 7ff02be00700 1 -- 172.21.15.5:0/3961496096 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff02401b440 con 0x7ff034106620 2024-01-24T15:34:12.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.406+0000 7ff02be00700 1 -- 172.21.15.5:0/3961496096 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff02401a3d0 con 0x7ff034106620 2024-01-24T15:34:12.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.406+0000 7ff03a800700 1 -- 172.21.15.5:0/3961496096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff03419d000 con 0x7ff034106620 2024-01-24T15:34:12.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.407+0000 7ff02be00700 1 -- 172.21.15.5:0/3961496096 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 45281+0+0 (secure 0 0 0) 0x7ff02401b5b0 con 0x7ff034106620 2024-01-24T15:34:12.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.407+0000 7ff03a800700 1 -- 172.21.15.5:0/3961496096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff034062370 con 0x7ff034106620 2024-01-24T15:34:12.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.408+0000 7ff02be00700 1 --2- 172.21.15.5:0/3961496096 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7ff014038350 0x7ff01403a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:12.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.408+0000 7ff02be00700 1 -- 172.21.15.5:0/3961496096 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff02404c1b0 con 0x7ff034106620 2024-01-24T15:34:12.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.408+0000 7ff032a00700 1 --2- 172.21.15.5:0/3961496096 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7ff014038350 0x7ff01403a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:12.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.409+0000 7ff032a00700 1 --2- 172.21.15.5:0/3961496096 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7ff014038350 0x7ff01403a810 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff01c006fd0 tx=0x7ff01c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:12.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.418+0000 7ff02be00700 1 -- 172.21.15.5:0/3961496096 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7ff024023be0 con 0x7ff034106620 2024-01-24T15:34:12.975 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.630+0000 7ff03a800700 1 -- 172.21.15.5:0/3961496096 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7ff03410aa20 con 0x7ff034106620 2024-01-24T15:34:12.976 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.630+0000 7ff02be00700 1 -- 172.21.15.5:0/3961496096 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7ff02401f070 con 0x7ff034106620 2024-01-24T15:34:12.976 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.633+0000 7ff03a800700 1 -- 172.21.15.5:0/3961496096 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7ff014038350 msgr2=0x7ff01403a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:12.976 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.633+0000 7ff03a800700 1 --2- 172.21.15.5:0/3961496096 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7ff014038350 0x7ff01403a810 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff01c006fd0 tx=0x7ff01c006e40 comp rx=0 tx=0).stop 2024-01-24T15:34:12.976 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.633+0000 7ff03a800700 1 -- 172.21.15.5:0/3961496096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff034106620 msgr2=0x7ff03419c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:12.976 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.633+0000 7ff03a800700 1 --2- 172.21.15.5:0/3961496096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff034106620 0x7ff03419c4a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff024000c00 tx=0x7ff0240119a0 comp rx=0 tx=0).stop 2024-01-24T15:34:12.976 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.633+0000 7ff03a800700 1 -- 172.21.15.5:0/3961496096 shutdown_connections 2024-01-24T15:34:12.976 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.633+0000 7ff03a800700 1 --2- 172.21.15.5:0/3961496096 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7ff014038350 0x7ff01403a810 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:12.976 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.633+0000 7ff03a800700 1 --2- 172.21.15.5:0/3961496096 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff034106620 0x7ff03419c4a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:12.976 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.633+0000 7ff03a800700 1 -- 172.21.15.5:0/3961496096 >> 172.21.15.5:0/3961496096 conn(0x7ff034101c00 msgr2=0x7ff0341029a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:12.976 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.633+0000 7ff03a800700 1 -- 172.21.15.5:0/3961496096 shutdown_connections 2024-01-24T15:34:12.976 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:12.633+0000 7ff03a800700 1 -- 172.21.15.5:0/3961496096 wait complete. 2024-01-24T15:34:14.014 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.372+0000 7fec81600700 1 Processor -- start 2024-01-24T15:34:14.014 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.372+0000 7fec81600700 1 -- start start 2024-01-24T15:34:14.014 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.373+0000 7fec81600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec7c106620 0x7fec7c106a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:14.014 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.373+0000 7fec81600700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c107010 con 0x7fec7c106620 2024-01-24T15:34:14.014 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.373+0000 7fec7aa00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec7c106620 0x7fec7c106a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:14.014 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.373+0000 7fec7aa00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec7c106620 0x7fec7c106a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48254/0 (socket says 172.21.15.5:48254) 2024-01-24T15:34:14.015 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.373+0000 7fec7aa00700 1 -- 172.21.15.5:0/1285134033 learned_addr learned my addr 172.21.15.5:0/1285134033 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:34:14.015 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.373+0000 7fec7aa00700 1 -- 172.21.15.5:0/1285134033 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c107820 con 0x7fec7c106620 2024-01-24T15:34:14.015 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.374+0000 7fec7aa00700 1 --2- 172.21.15.5:0/1285134033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec7c106620 0x7fec7c106a40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fec6c0098a0 tx=0x7fec6c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e16a3d9e06416307 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:14.015 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.374+0000 7fec79600700 1 -- 172.21.15.5:0/1285134033 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec6c004160 con 0x7fec7c106620 2024-01-24T15:34:14.015 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.374+0000 7fec79600700 1 -- 172.21.15.5:0/1285134033 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec6c0042c0 con 0x7fec7c106620 2024-01-24T15:34:14.015 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.374+0000 7fec79600700 1 -- 172.21.15.5:0/1285134033 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec6c0118e0 con 0x7fec7c106620 2024-01-24T15:34:14.015 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.374+0000 7fec81600700 1 -- 172.21.15.5:0/1285134033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec7c106620 msgr2=0x7fec7c106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:14.015 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.374+0000 7fec81600700 1 --2- 172.21.15.5:0/1285134033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec7c106620 0x7fec7c106a40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fec6c0098a0 tx=0x7fec6c009bb0 comp rx=0 tx=0).stop 2024-01-24T15:34:14.015 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.374+0000 7fec81600700 1 -- 172.21.15.5:0/1285134033 shutdown_connections 2024-01-24T15:34:14.015 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.374+0000 7fec81600700 1 --2- 172.21.15.5:0/1285134033 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec7c106620 0x7fec7c106a40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:14.015 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.375+0000 7fec81600700 1 -- 172.21.15.5:0/1285134033 >> 172.21.15.5:0/1285134033 conn(0x7fec7c101c00 msgr2=0x7fec7c104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:14.015 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.375+0000 7fec81600700 1 -- 172.21.15.5:0/1285134033 shutdown_connections 2024-01-24T15:34:14.015 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.375+0000 7fec81600700 1 -- 172.21.15.5:0/1285134033 wait complete. 2024-01-24T15:34:14.015 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.376+0000 7fec81600700 1 Processor -- start 2024-01-24T15:34:14.016 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.376+0000 7fec81600700 1 -- start start 2024-01-24T15:34:14.016 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.376+0000 7fec81600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec7c106620 0x7fec7c07ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:14.016 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.376+0000 7fec81600700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c07b070 con 0x7fec7c106620 2024-01-24T15:34:14.016 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.376+0000 7fec7aa00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec7c106620 0x7fec7c07ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:14.016 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.376+0000 7fec7aa00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec7c106620 0x7fec7c07ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48258/0 (socket says 172.21.15.5:48258) 2024-01-24T15:34:14.016 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.376+0000 7fec7aa00700 1 -- 172.21.15.5:0/2723695533 learned_addr learned my addr 172.21.15.5:0/2723695533 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:34:14.016 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.377+0000 7fec7aa00700 1 -- 172.21.15.5:0/2723695533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c009550 con 0x7fec7c106620 2024-01-24T15:34:14.016 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.377+0000 7fec7aa00700 1 --2- 172.21.15.5:0/2723695533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec7c106620 0x7fec7c07ab30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fec6c006af0 tx=0x7fec6c011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:14.016 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.377+0000 7fec73400700 1 -- 172.21.15.5:0/2723695533 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec6c0037d0 con 0x7fec7c106620 2024-01-24T15:34:14.016 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.377+0000 7fec73400700 1 -- 172.21.15.5:0/2723695533 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec6c01b440 con 0x7fec7c106620 2024-01-24T15:34:14.016 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.377+0000 7fec73400700 1 -- 172.21.15.5:0/2723695533 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec6c019560 con 0x7fec7c106620 2024-01-24T15:34:14.016 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.377+0000 7fec81600700 1 -- 172.21.15.5:0/2723695533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec7c079180 con 0x7fec7c106620 2024-01-24T15:34:14.016 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.377+0000 7fec81600700 1 -- 172.21.15.5:0/2723695533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec7c0795a0 con 0x7fec7c106620 2024-01-24T15:34:14.017 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.378+0000 7fec73400700 1 -- 172.21.15.5:0/2723695533 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 12) v1 ==== 45281+0+0 (secure 0 0 0) 0x7fec6c003930 con 0x7fec7c106620 2024-01-24T15:34:14.017 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.378+0000 7fec81600700 1 -- 172.21.15.5:0/2723695533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec7c062370 con 0x7fec7c106620 2024-01-24T15:34:14.017 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.379+0000 7fec73400700 1 --2- 172.21.15.5:0/2723695533 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fec5c038350 0x7fec5c03a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:14.017 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.379+0000 7fec73400700 1 -- 172.21.15.5:0/2723695533 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fec6c04c1a0 con 0x7fec7c106620 2024-01-24T15:34:14.017 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.379+0000 7fec7a000700 1 --2- 172.21.15.5:0/2723695533 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fec5c038350 0x7fec5c03a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:14.017 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.380+0000 7fec7a000700 1 --2- 172.21.15.5:0/2723695533 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fec5c038350 0x7fec5c03a810 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fec64006fd0 tx=0x7fec64006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:14.017 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.384+0000 7fec73400700 1 -- 172.21.15.5:0/2723695533 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7fec6c018350 con 0x7fec7c106620 2024-01-24T15:34:14.017 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.521+0000 7fec73400700 1 -- 172.21.15.5:0/2723695533 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 13) v1 ==== 45323+0+0 (secure 0 0 0) 0x7fec6c019cf0 con 0x7fec7c106620 2024-01-24T15:34:14.017 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.704+0000 7fec81600700 1 -- 172.21.15.5:0/2723695533 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fec7c079d60 con 0x7fec7c106620 2024-01-24T15:34:14.017 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.707+0000 7fec73400700 1 -- 172.21.15.5:0/2723695533 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7fec6c018740 con 0x7fec7c106620 2024-01-24T15:34:14.017 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.709+0000 7fec81600700 1 -- 172.21.15.5:0/2723695533 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fec5c038350 msgr2=0x7fec5c03a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:14.017 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.709+0000 7fec81600700 1 --2- 172.21.15.5:0/2723695533 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fec5c038350 0x7fec5c03a810 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fec64006fd0 tx=0x7fec64006e40 comp rx=0 tx=0).stop 2024-01-24T15:34:14.017 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.709+0000 7fec81600700 1 -- 172.21.15.5:0/2723695533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec7c106620 msgr2=0x7fec7c07ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:14.018 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.709+0000 7fec81600700 1 --2- 172.21.15.5:0/2723695533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec7c106620 0x7fec7c07ab30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fec6c006af0 tx=0x7fec6c011e80 comp rx=0 tx=0).stop 2024-01-24T15:34:14.018 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.709+0000 7fec81600700 1 -- 172.21.15.5:0/2723695533 shutdown_connections 2024-01-24T15:34:14.018 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.709+0000 7fec81600700 1 --2- 172.21.15.5:0/2723695533 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fec5c038350 0x7fec5c03a810 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:14.018 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.709+0000 7fec81600700 1 --2- 172.21.15.5:0/2723695533 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec7c106620 0x7fec7c07ab30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:14.018 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.709+0000 7fec81600700 1 -- 172.21.15.5:0/2723695533 >> 172.21.15.5:0/2723695533 conn(0x7fec7c101c00 msgr2=0x7fec7c1032b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:14.018 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.710+0000 7fec81600700 1 -- 172.21.15.5:0/2723695533 shutdown_connections 2024-01-24T15:34:14.018 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr 2024-01-24T15:34:13.710+0000 7fec81600700 1 -- 172.21.15.5:0/2723695533 wait complete. 2024-01-24T15:34:14.018 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-01-24T15:34:14.018 INFO:teuthology.orchestra.run.smithi005.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-01-24T15:34:14.018 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:34:14.018 INFO:teuthology.orchestra.run.smithi005.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-01-24T15:34:14.018 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:34:14.018 INFO:teuthology.orchestra.run.smithi005.stdout:Or, if you are only running a single cluster on this host: 2024-01-24T15:34:14.018 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:34:14.019 INFO:teuthology.orchestra.run.smithi005.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-01-24T15:34:14.019 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:34:14.019 INFO:teuthology.orchestra.run.smithi005.stdout:Please consider enabling telemetry to help improve Ceph: 2024-01-24T15:34:14.019 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:34:14.019 INFO:teuthology.orchestra.run.smithi005.stdout: ceph telemetry on 2024-01-24T15:34:14.019 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:34:14.019 INFO:teuthology.orchestra.run.smithi005.stdout:For more information see: 2024-01-24T15:34:14.019 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:34:14.019 INFO:teuthology.orchestra.run.smithi005.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-01-24T15:34:14.019 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:34:14.019 INFO:teuthology.orchestra.run.smithi005.stdout:Bootstrap complete. 2024-01-24T15:34:14.069 INFO:tasks.cephadm:Fetching config... 2024-01-24T15:34:14.069 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-01-24T15:34:14.069 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-01-24T15:34:14.112 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-01-24T15:34:14.112 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-01-24T15:34:14.112 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-01-24T15:34:14.195 INFO:tasks.cephadm:Fetching mon keyring... 2024-01-24T15:34:14.196 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-01-24T15:34:14.196 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.a/keyring of=/dev/stdout 2024-01-24T15:34:14.318 INFO:tasks.cephadm:Fetching pub ssh key... 2024-01-24T15:34:14.318 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-01-24T15:34:14.318 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-01-24T15:34:14.401 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-01-24T15:34:14.401 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCc+OY9hEhcrcd7n+84M2NAt124nQqcFgVvjj5F+CXV2oZeYXx0ZmckT0cKkh6TdewNH4KeLZoypB1CHDkysmQ064K+MQfRHcCcl1mUT8vAtqhmVVb+9nMRJv4crkefUE1os9Af6I6ynndry5ktd+qGQYDPPx0vHt9IcL5vQWBYrhqucEusbS6Vgp+cbTbLPwCzPgh7ALoCFvYeoTZerZfkejqz3F+w+RTR7YzTjr+POHUsJYYfqFkm6wlOFkH8G41lBnicA1989cLQbCGSSvQNSi5lM5wMRYiL9JFR8P8gwElyINMZf1V3yNY4hktO5PMTPL3N82MLa6LFKf/WE/T2QJ7FoBm2nYqppsKUANIc+dWNMmuJJeN1LIvi+6T2JsTBRuIeGPlumxEaMzU2Mbweq/labJW2xBlYCcCvQM0KWMvLDOzNCKEcslh0ZsFE4ZkuJnIYnfpCqrN/BAMHgrhbl03GK4+AmfYYqIXGHcp5gXfM2w/ODL3h5jd0lynLi3M= ceph-bede0bb6-bacd-11ee-95b1-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-01-24T15:34:14.534 INFO:teuthology.orchestra.run.smithi005.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCc+OY9hEhcrcd7n+84M2NAt124nQqcFgVvjj5F+CXV2oZeYXx0ZmckT0cKkh6TdewNH4KeLZoypB1CHDkysmQ064K+MQfRHcCcl1mUT8vAtqhmVVb+9nMRJv4crkefUE1os9Af6I6ynndry5ktd+qGQYDPPx0vHt9IcL5vQWBYrhqucEusbS6Vgp+cbTbLPwCzPgh7ALoCFvYeoTZerZfkejqz3F+w+RTR7YzTjr+POHUsJYYfqFkm6wlOFkH8G41lBnicA1989cLQbCGSSvQNSi5lM5wMRYiL9JFR8P8gwElyINMZf1V3yNY4hktO5PMTPL3N82MLa6LFKf/WE/T2QJ7FoBm2nYqppsKUANIc+dWNMmuJJeN1LIvi+6T2JsTBRuIeGPlumxEaMzU2Mbweq/labJW2xBlYCcCvQM0KWMvLDOzNCKEcslh0ZsFE4ZkuJnIYnfpCqrN/BAMHgrhbl03GK4+AmfYYqIXGHcp5gXfM2w/ODL3h5jd0lynLi3M= ceph-bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:34:14.564 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCc+OY9hEhcrcd7n+84M2NAt124nQqcFgVvjj5F+CXV2oZeYXx0ZmckT0cKkh6TdewNH4KeLZoypB1CHDkysmQ064K+MQfRHcCcl1mUT8vAtqhmVVb+9nMRJv4crkefUE1os9Af6I6ynndry5ktd+qGQYDPPx0vHt9IcL5vQWBYrhqucEusbS6Vgp+cbTbLPwCzPgh7ALoCFvYeoTZerZfkejqz3F+w+RTR7YzTjr+POHUsJYYfqFkm6wlOFkH8G41lBnicA1989cLQbCGSSvQNSi5lM5wMRYiL9JFR8P8gwElyINMZf1V3yNY4hktO5PMTPL3N82MLa6LFKf/WE/T2QJ7FoBm2nYqppsKUANIc+dWNMmuJJeN1LIvi+6T2JsTBRuIeGPlumxEaMzU2Mbweq/labJW2xBlYCcCvQM0KWMvLDOzNCKEcslh0ZsFE4ZkuJnIYnfpCqrN/BAMHgrhbl03GK4+AmfYYqIXGHcp5gXfM2w/ODL3h5jd0lynLi3M= ceph-bede0bb6-bacd-11ee-95b1-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-01-24T15:34:14.664 INFO:teuthology.orchestra.run.smithi160.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCc+OY9hEhcrcd7n+84M2NAt124nQqcFgVvjj5F+CXV2oZeYXx0ZmckT0cKkh6TdewNH4KeLZoypB1CHDkysmQ064K+MQfRHcCcl1mUT8vAtqhmVVb+9nMRJv4crkefUE1os9Af6I6ynndry5ktd+qGQYDPPx0vHt9IcL5vQWBYrhqucEusbS6Vgp+cbTbLPwCzPgh7ALoCFvYeoTZerZfkejqz3F+w+RTR7YzTjr+POHUsJYYfqFkm6wlOFkH8G41lBnicA1989cLQbCGSSvQNSi5lM5wMRYiL9JFR8P8gwElyINMZf1V3yNY4hktO5PMTPL3N82MLa6LFKf/WE/T2QJ7FoBm2nYqppsKUANIc+dWNMmuJJeN1LIvi+6T2JsTBRuIeGPlumxEaMzU2Mbweq/labJW2xBlYCcCvQM0KWMvLDOzNCKEcslh0ZsFE4ZkuJnIYnfpCqrN/BAMHgrhbl03GK4+AmfYYqIXGHcp5gXfM2w/ODL3h5jd0lynLi3M= ceph-bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:34:14.692 DEBUG:teuthology.orchestra.run.smithi204:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCc+OY9hEhcrcd7n+84M2NAt124nQqcFgVvjj5F+CXV2oZeYXx0ZmckT0cKkh6TdewNH4KeLZoypB1CHDkysmQ064K+MQfRHcCcl1mUT8vAtqhmVVb+9nMRJv4crkefUE1os9Af6I6ynndry5ktd+qGQYDPPx0vHt9IcL5vQWBYrhqucEusbS6Vgp+cbTbLPwCzPgh7ALoCFvYeoTZerZfkejqz3F+w+RTR7YzTjr+POHUsJYYfqFkm6wlOFkH8G41lBnicA1989cLQbCGSSvQNSi5lM5wMRYiL9JFR8P8gwElyINMZf1V3yNY4hktO5PMTPL3N82MLa6LFKf/WE/T2QJ7FoBm2nYqppsKUANIc+dWNMmuJJeN1LIvi+6T2JsTBRuIeGPlumxEaMzU2Mbweq/labJW2xBlYCcCvQM0KWMvLDOzNCKEcslh0ZsFE4ZkuJnIYnfpCqrN/BAMHgrhbl03GK4+AmfYYqIXGHcp5gXfM2w/ODL3h5jd0lynLi3M= ceph-bede0bb6-bacd-11ee-95b1-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-01-24T15:34:14.791 INFO:teuthology.orchestra.run.smithi204.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCc+OY9hEhcrcd7n+84M2NAt124nQqcFgVvjj5F+CXV2oZeYXx0ZmckT0cKkh6TdewNH4KeLZoypB1CHDkysmQ064K+MQfRHcCcl1mUT8vAtqhmVVb+9nMRJv4crkefUE1os9Af6I6ynndry5ktd+qGQYDPPx0vHt9IcL5vQWBYrhqucEusbS6Vgp+cbTbLPwCzPgh7ALoCFvYeoTZerZfkejqz3F+w+RTR7YzTjr+POHUsJYYfqFkm6wlOFkH8G41lBnicA1989cLQbCGSSvQNSi5lM5wMRYiL9JFR8P8gwElyINMZf1V3yNY4hktO5PMTPL3N82MLa6LFKf/WE/T2QJ7FoBm2nYqppsKUANIc+dWNMmuJJeN1LIvi+6T2JsTBRuIeGPlumxEaMzU2Mbweq/labJW2xBlYCcCvQM0KWMvLDOzNCKEcslh0ZsFE4ZkuJnIYnfpCqrN/BAMHgrhbl03GK4+AmfYYqIXGHcp5gXfM2w/ODL3h5jd0lynLi3M= ceph-bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:34:14.821 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-01-24T15:34:14.882 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:14 smithi005 ceph-mon[35346]: mgrmap e13: x(active, since 6s) 2024-01-24T15:34:14.898 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:14 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/2723695533' entity='client.admin' 2024-01-24T15:34:15.213 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.a/config 2024-01-24T15:34:16.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.526+0000 7fdf02e00700 1 -- 172.21.15.5:0/2955778137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdefc074d70 msgr2=0x7fdefc0731d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:16.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.526+0000 7fdf02e00700 1 --2- 172.21.15.5:0/2955778137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdefc074d70 0x7fdefc0731d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009910 tx=0x7fdeec009c20 comp rx=0 tx=0).stop 2024-01-24T15:34:16.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.526+0000 7fdf02e00700 1 -- 172.21.15.5:0/2955778137 shutdown_connections 2024-01-24T15:34:16.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.526+0000 7fdf02e00700 1 --2- 172.21.15.5:0/2955778137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdefc074d70 0x7fdefc0731d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:16.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.526+0000 7fdf02e00700 1 -- 172.21.15.5:0/2955778137 >> 172.21.15.5:0/2955778137 conn(0x7fdefc0fbdb0 msgr2=0x7fdefc0fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:16.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.526+0000 7fdf02e00700 1 -- 172.21.15.5:0/2955778137 shutdown_connections 2024-01-24T15:34:16.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.526+0000 7fdf02e00700 1 -- 172.21.15.5:0/2955778137 wait complete. 2024-01-24T15:34:16.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.527+0000 7fdf02e00700 1 Processor -- start 2024-01-24T15:34:16.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.528+0000 7fdf02e00700 1 -- start start 2024-01-24T15:34:16.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.528+0000 7fdf02e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdefc074d70 0x7fdefc19be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:16.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.528+0000 7fdf02e00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc19c370 con 0x7fdefc074d70 2024-01-24T15:34:16.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.528+0000 7fdefbe00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdefc074d70 0x7fdefc19be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:16.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.528+0000 7fdefbe00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdefc074d70 0x7fdefc19be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48280/0 (socket says 172.21.15.5:48280) 2024-01-24T15:34:16.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.528+0000 7fdefbe00700 1 -- 172.21.15.5:0/597224005 learned_addr learned my addr 172.21.15.5:0/597224005 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:34:16.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.529+0000 7fdefbe00700 1 -- 172.21.15.5:0/597224005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec0095f0 con 0x7fdefc074d70 2024-01-24T15:34:16.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.529+0000 7fdefbe00700 1 --2- 172.21.15.5:0/597224005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdefc074d70 0x7fdefc19be30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdeec005950 tx=0x7fdeec005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:16.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.529+0000 7fdef8c00700 1 -- 172.21.15.5:0/597224005 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdeec00ba90 con 0x7fdefc074d70 2024-01-24T15:34:16.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.529+0000 7fdef8c00700 1 -- 172.21.15.5:0/597224005 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdeec00bbf0 con 0x7fdefc074d70 2024-01-24T15:34:16.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.529+0000 7fdef8c00700 1 -- 172.21.15.5:0/597224005 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdeec017440 con 0x7fdefc074d70 2024-01-24T15:34:16.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.529+0000 7fdf02e00700 1 -- 172.21.15.5:0/597224005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdefc19c570 con 0x7fdefc074d70 2024-01-24T15:34:16.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.529+0000 7fdf02e00700 1 -- 172.21.15.5:0/597224005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdefc19ca10 con 0x7fdefc074d70 2024-01-24T15:34:16.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.531+0000 7fdf02e00700 1 -- 172.21.15.5:0/597224005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdefc195800 con 0x7fdefc074d70 2024-01-24T15:34:16.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.531+0000 7fdef8c00700 1 -- 172.21.15.5:0/597224005 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45323+0+0 (secure 0 0 0) 0x7fdeec00f460 con 0x7fdefc074d70 2024-01-24T15:34:16.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.532+0000 7fdef8c00700 1 --2- 172.21.15.5:0/597224005 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fdedc0383f0 0x7fdedc03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:16.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.532+0000 7fdef8c00700 1 -- 172.21.15.5:0/597224005 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fdeec04c3f0 con 0x7fdefc074d70 2024-01-24T15:34:16.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.532+0000 7fdefb400700 1 --2- 172.21.15.5:0/597224005 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fdedc0383f0 0x7fdedc03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:16.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.532+0000 7fdefb400700 1 --2- 172.21.15.5:0/597224005 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fdedc0383f0 0x7fdedc03a8b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdee4006fd0 tx=0x7fdee4006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:16.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.537+0000 7fdef8c00700 1 -- 172.21.15.5:0/597224005 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7fdeec02ad30 con 0x7fdefc074d70 2024-01-24T15:34:16.745 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.743+0000 7fdf02e00700 1 -- 172.21.15.5:0/597224005 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fdefc02d090 con 0x7fdefc074d70 2024-01-24T15:34:16.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.748+0000 7fdef8c00700 1 -- 172.21.15.5:0/597224005 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fdeec027070 con 0x7fdefc074d70 2024-01-24T15:34:16.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.750+0000 7fdf02e00700 1 -- 172.21.15.5:0/597224005 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fdedc0383f0 msgr2=0x7fdedc03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:16.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.750+0000 7fdf02e00700 1 --2- 172.21.15.5:0/597224005 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fdedc0383f0 0x7fdedc03a8b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdee4006fd0 tx=0x7fdee4006e40 comp rx=0 tx=0).stop 2024-01-24T15:34:16.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.751+0000 7fdf02e00700 1 -- 172.21.15.5:0/597224005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdefc074d70 msgr2=0x7fdefc19be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:16.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.751+0000 7fdf02e00700 1 --2- 172.21.15.5:0/597224005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdefc074d70 0x7fdefc19be30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdeec005950 tx=0x7fdeec005810 comp rx=0 tx=0).stop 2024-01-24T15:34:16.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.751+0000 7fdf02e00700 1 -- 172.21.15.5:0/597224005 shutdown_connections 2024-01-24T15:34:16.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.751+0000 7fdf02e00700 1 --2- 172.21.15.5:0/597224005 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fdedc0383f0 0x7fdedc03a8b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:16.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.751+0000 7fdf02e00700 1 --2- 172.21.15.5:0/597224005 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdefc074d70 0x7fdefc19be30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:16.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.751+0000 7fdf02e00700 1 -- 172.21.15.5:0/597224005 >> 172.21.15.5:0/597224005 conn(0x7fdefc0fbdb0 msgr2=0x7fdefc0fcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:16.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.751+0000 7fdf02e00700 1 -- 172.21.15.5:0/597224005 shutdown_connections 2024-01-24T15:34:16.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:16.751+0000 7fdf02e00700 1 -- 172.21.15.5:0/597224005 wait complete. 2024-01-24T15:34:17.100 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-01-24T15:34:17.100 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-01-24T15:34:17.505 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.a/config 2024-01-24T15:34:17.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:17 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/597224005' entity='client.admin' 2024-01-24T15:34:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.955+0000 7f80e8400700 1 -- 172.21.15.5:0/4254231934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e0074d70 msgr2=0x7f80e00731d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.955+0000 7f80e8400700 1 --2- 172.21.15.5:0/4254231934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e0074d70 0x7f80e00731d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f80d0009910 tx=0x7f80d0009c20 comp rx=0 tx=0).stop 2024-01-24T15:34:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.955+0000 7f80e8400700 1 -- 172.21.15.5:0/4254231934 shutdown_connections 2024-01-24T15:34:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.955+0000 7f80e8400700 1 --2- 172.21.15.5:0/4254231934 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e0074d70 0x7f80e00731d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.955+0000 7f80e8400700 1 -- 172.21.15.5:0/4254231934 >> 172.21.15.5:0/4254231934 conn(0x7f80e00fbdd0 msgr2=0x7f80e00fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.955+0000 7f80e8400700 1 -- 172.21.15.5:0/4254231934 shutdown_connections 2024-01-24T15:34:18.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.955+0000 7f80e8400700 1 -- 172.21.15.5:0/4254231934 wait complete. 2024-01-24T15:34:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.956+0000 7f80e8400700 1 Processor -- start 2024-01-24T15:34:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.957+0000 7f80e8400700 1 -- start start 2024-01-24T15:34:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.957+0000 7f80e8400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e0074d70 0x7f80e019be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:18.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.957+0000 7f80e8400700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e019c390 con 0x7f80e0074d70 2024-01-24T15:34:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.957+0000 7f80e5a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e0074d70 0x7f80e019be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.957+0000 7f80e5a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e0074d70 0x7f80e019be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48290/0 (socket says 172.21.15.5:48290) 2024-01-24T15:34:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.957+0000 7f80e5a00700 1 -- 172.21.15.5:0/3969386236 learned_addr learned my addr 172.21.15.5:0/3969386236 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:34:18.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.957+0000 7f80e5a00700 1 -- 172.21.15.5:0/3969386236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d00095f0 con 0x7f80e0074d70 2024-01-24T15:34:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.958+0000 7f80e5a00700 1 --2- 172.21.15.5:0/3969386236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e0074d70 0x7f80e019be50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f80d0005950 tx=0x7f80d0005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.958+0000 7f80de000700 1 -- 172.21.15.5:0/3969386236 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80d000ba90 con 0x7f80e0074d70 2024-01-24T15:34:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.958+0000 7f80de000700 1 -- 172.21.15.5:0/3969386236 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f80d000bbf0 con 0x7f80e0074d70 2024-01-24T15:34:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.958+0000 7f80de000700 1 -- 172.21.15.5:0/3969386236 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f80d0017440 con 0x7f80e0074d70 2024-01-24T15:34:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.958+0000 7f80e8400700 1 -- 172.21.15.5:0/3969386236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e019c590 con 0x7f80e0074d70 2024-01-24T15:34:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.958+0000 7f80e8400700 1 -- 172.21.15.5:0/3969386236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e019ca30 con 0x7f80e0074d70 2024-01-24T15:34:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.959+0000 7f80de000700 1 -- 172.21.15.5:0/3969386236 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45323+0+0 (secure 0 0 0) 0x7f80d000f460 con 0x7f80e0074d70 2024-01-24T15:34:18.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.959+0000 7f80e8400700 1 -- 172.21.15.5:0/3969386236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e0195820 con 0x7f80e0074d70 2024-01-24T15:34:18.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.959+0000 7f80de000700 1 --2- 172.21.15.5:0/3969386236 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f80c00383f0 0x7f80c003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:18.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.960+0000 7f80de000700 1 -- 172.21.15.5:0/3969386236 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f80d004c430 con 0x7f80e0074d70 2024-01-24T15:34:18.961 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.960+0000 7f80e5000700 1 --2- 172.21.15.5:0/3969386236 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f80c00383f0 0x7f80c003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:18.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.960+0000 7f80e5000700 1 --2- 172.21.15.5:0/3969386236 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f80c00383f0 0x7f80c003a8b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f80c8006fd0 tx=0x7f80c8006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:18.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:18.965+0000 7f80de000700 1 -- 172.21.15.5:0/3969386236 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f80d002ad30 con 0x7f80e0074d70 2024-01-24T15:34:19.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:19.177+0000 7f80e8400700 1 -- 172.21.15.5:0/3969386236 --> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f80e0061180 con 0x7f80c00383f0 2024-01-24T15:34:19.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:19.180+0000 7f80de000700 1 -- 172.21.15.5:0/3969386236 <== mgr.14150 v2:172.21.15.5:6800/1971309753 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f80e0061180 con 0x7f80c00383f0 2024-01-24T15:34:19.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:19.183+0000 7f80e8400700 1 -- 172.21.15.5:0/3969386236 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f80c00383f0 msgr2=0x7f80c003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:19.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:19.183+0000 7f80e8400700 1 --2- 172.21.15.5:0/3969386236 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f80c00383f0 0x7f80c003a8b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f80c8006fd0 tx=0x7f80c8006e40 comp rx=0 tx=0).stop 2024-01-24T15:34:19.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:19.183+0000 7f80e8400700 1 -- 172.21.15.5:0/3969386236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e0074d70 msgr2=0x7f80e019be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:19.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:19.183+0000 7f80e8400700 1 --2- 172.21.15.5:0/3969386236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e0074d70 0x7f80e019be50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f80d0005950 tx=0x7f80d0005810 comp rx=0 tx=0).stop 2024-01-24T15:34:19.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:19.183+0000 7f80e8400700 1 -- 172.21.15.5:0/3969386236 shutdown_connections 2024-01-24T15:34:19.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:19.183+0000 7f80e8400700 1 --2- 172.21.15.5:0/3969386236 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f80c00383f0 0x7f80c003a8b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:19.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:19.183+0000 7f80e8400700 1 --2- 172.21.15.5:0/3969386236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f80e0074d70 0x7f80e019be50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:19.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:19.183+0000 7f80e8400700 1 -- 172.21.15.5:0/3969386236 >> 172.21.15.5:0/3969386236 conn(0x7f80e00fbdd0 msgr2=0x7f80e00fcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:19.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:19.183+0000 7f80e8400700 1 -- 172.21.15.5:0/3969386236 shutdown_connections 2024-01-24T15:34:19.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:19.183+0000 7f80e8400700 1 -- 172.21.15.5:0/3969386236 wait complete. 2024-01-24T15:34:19.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:19 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:19.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:19 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:19.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:19 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi005", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:34:19.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:19 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:19.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:19 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:34:19.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:19 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:19.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:19 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:19.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:19 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:34:19.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:19 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:34:19.475 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:19 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:34:19.664 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi160 2024-01-24T15:34:19.665 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-01-24T15:34:19.665 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/etc/ceph/ceph.conf 2024-01-24T15:34:19.711 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-01-24T15:34:19.711 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-01-24T15:34:19.795 INFO:tasks.cephadm:Adding host smithi160 to orchestrator... 2024-01-24T15:34:19.796 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph orch host add smithi160 2024-01-24T15:34:20.165 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.a/config 2024-01-24T15:34:20.657 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:20 smithi005 ceph-mon[35346]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:34:20.657 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:20 smithi005 ceph-mon[35346]: Updating smithi005:/etc/ceph/ceph.conf 2024-01-24T15:34:21.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.306+0000 7f5c2dc00700 1 -- 172.21.15.5:0/1386496338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c28101970 msgr2=0x7f5c28101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:21.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.306+0000 7f5c2dc00700 1 --2- 172.21.15.5:0/1386496338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c28101970 0x7f5c28101d50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5c18009910 tx=0x7f5c18009c20 comp rx=0 tx=0).stop 2024-01-24T15:34:21.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.306+0000 7f5c2dc00700 1 -- 172.21.15.5:0/1386496338 shutdown_connections 2024-01-24T15:34:21.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.306+0000 7f5c2dc00700 1 --2- 172.21.15.5:0/1386496338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c28101970 0x7f5c28101d50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:21.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.306+0000 7f5c2dc00700 1 -- 172.21.15.5:0/1386496338 >> 172.21.15.5:0/1386496338 conn(0x7f5c280fb1c0 msgr2=0x7f5c280fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:21.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.306+0000 7f5c2dc00700 1 -- 172.21.15.5:0/1386496338 shutdown_connections 2024-01-24T15:34:21.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.306+0000 7f5c2dc00700 1 -- 172.21.15.5:0/1386496338 wait complete. 2024-01-24T15:34:21.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.307+0000 7f5c2dc00700 1 Processor -- start 2024-01-24T15:34:21.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.307+0000 7f5c2dc00700 1 -- start start 2024-01-24T15:34:21.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.308+0000 7f5c2dc00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c28101970 0x7f5c280ff5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:21.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.308+0000 7f5c2dc00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c28101550 con 0x7f5c28101970 2024-01-24T15:34:21.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.308+0000 7f5c26a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c28101970 0x7f5c280ff5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:21.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.308+0000 7f5c26a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c28101970 0x7f5c280ff5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48296/0 (socket says 172.21.15.5:48296) 2024-01-24T15:34:21.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.308+0000 7f5c26a00700 1 -- 172.21.15.5:0/3999997233 learned_addr learned my addr 172.21.15.5:0/3999997233 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:34:21.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.308+0000 7f5c26a00700 1 -- 172.21.15.5:0/3999997233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c180095f0 con 0x7f5c28101970 2024-01-24T15:34:21.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.309+0000 7f5c26a00700 1 --2- 172.21.15.5:0/3999997233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c28101970 0x7f5c280ff5d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5c18006010 tx=0x7f5c18004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:21.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.309+0000 7f5c1f400700 1 -- 172.21.15.5:0/3999997233 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c1801d070 con 0x7f5c28101970 2024-01-24T15:34:21.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.309+0000 7f5c1f400700 1 -- 172.21.15.5:0/3999997233 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5c1800bdf0 con 0x7f5c28101970 2024-01-24T15:34:21.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.309+0000 7f5c2dc00700 1 -- 172.21.15.5:0/3999997233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c280ffb10 con 0x7f5c28101970 2024-01-24T15:34:21.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.309+0000 7f5c1f400700 1 -- 172.21.15.5:0/3999997233 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5c18022d80 con 0x7f5c28101970 2024-01-24T15:34:21.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.309+0000 7f5c2dc00700 1 -- 172.21.15.5:0/3999997233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c280fff90 con 0x7f5c28101970 2024-01-24T15:34:21.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.310+0000 7f5c1f400700 1 -- 172.21.15.5:0/3999997233 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45323+0+0 (secure 0 0 0) 0x7f5c18022570 con 0x7f5c28101970 2024-01-24T15:34:21.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.310+0000 7f5c2dc00700 1 -- 172.21.15.5:0/3999997233 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c28107f20 con 0x7f5c28101970 2024-01-24T15:34:21.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.311+0000 7f5c1f400700 1 --2- 172.21.15.5:0/3999997233 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5c08038340 0x7f5c0803a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:21.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.311+0000 7f5c1f400700 1 -- 172.21.15.5:0/3999997233 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5c1804c3e0 con 0x7f5c28101970 2024-01-24T15:34:21.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.311+0000 7f5c26000700 1 --2- 172.21.15.5:0/3999997233 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5c08038340 0x7f5c0803a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:21.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.312+0000 7f5c26000700 1 --2- 172.21.15.5:0/3999997233 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5c08038340 0x7f5c0803a800 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5c10006fd0 tx=0x7f5c10006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:21.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.316+0000 7f5c1f400700 1 -- 172.21.15.5:0/3999997233 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f5c1802a540 con 0x7f5c28101970 2024-01-24T15:34:21.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:21.530+0000 7f5c2dc00700 1 -- 172.21.15.5:0/3999997233 --> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi160", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c28100290 con 0x7f5c08038340 2024-01-24T15:34:21.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:21 smithi005 ceph-mon[35346]: Updating smithi005:/var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/config/ceph.conf 2024-01-24T15:34:21.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:21 smithi005 ceph-mon[35346]: Updating smithi005:/etc/ceph/ceph.client.admin.keyring 2024-01-24T15:34:21.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:21 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:21.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:21 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:21.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:21 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:22.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:22 smithi005 ceph-mon[35346]: Updating smithi005:/var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/config/ceph.client.admin.keyring 2024-01-24T15:34:23.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:23 smithi005 ceph-mon[35346]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi160", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:34:23.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:23 smithi005 ceph-mon[35346]: Deploying cephadm binary to smithi160 2024-01-24T15:34:24.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:24.496+0000 7f5c1f400700 1 -- 172.21.15.5:0/3999997233 <== mgr.14150 v2:172.21.15.5:6800/1971309753 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f5c28100290 con 0x7f5c08038340 2024-01-24T15:34:24.498 INFO:teuthology.orchestra.run.smithi005.stdout:Added host 'smithi160' with addr '172.21.15.160' 2024-01-24T15:34:24.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:24.498+0000 7f5c2dc00700 1 -- 172.21.15.5:0/3999997233 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5c08038340 msgr2=0x7f5c0803a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:24.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:24.498+0000 7f5c2dc00700 1 --2- 172.21.15.5:0/3999997233 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5c08038340 0x7f5c0803a800 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5c10006fd0 tx=0x7f5c10006e40 comp rx=0 tx=0).stop 2024-01-24T15:34:24.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:24.498+0000 7f5c2dc00700 1 -- 172.21.15.5:0/3999997233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c28101970 msgr2=0x7f5c280ff5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:24.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:24.498+0000 7f5c2dc00700 1 --2- 172.21.15.5:0/3999997233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c28101970 0x7f5c280ff5d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5c18006010 tx=0x7f5c18004f40 comp rx=0 tx=0).stop 2024-01-24T15:34:24.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:24.498+0000 7f5c2dc00700 1 -- 172.21.15.5:0/3999997233 shutdown_connections 2024-01-24T15:34:24.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:24.498+0000 7f5c2dc00700 1 --2- 172.21.15.5:0/3999997233 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5c08038340 0x7f5c0803a800 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:24.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:24.498+0000 7f5c2dc00700 1 --2- 172.21.15.5:0/3999997233 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5c28101970 0x7f5c280ff5d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:24.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:24.498+0000 7f5c2dc00700 1 -- 172.21.15.5:0/3999997233 >> 172.21.15.5:0/3999997233 conn(0x7f5c280fb1c0 msgr2=0x7f5c28105060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:24.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:24.498+0000 7f5c2dc00700 1 -- 172.21.15.5:0/3999997233 shutdown_connections 2024-01-24T15:34:24.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:24.498+0000 7f5c2dc00700 1 -- 172.21.15.5:0/3999997233 wait complete. 2024-01-24T15:34:24.858 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph orch host ls --format=json 2024-01-24T15:34:25.215 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.a/config 2024-01-24T15:34:25.664 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:25 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:25.664 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:25 smithi005 ceph-mon[35346]: Added host smithi160 2024-01-24T15:34:25.664 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:25 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:34:25.664 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:25 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:25.664 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:25 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.265+0000 7f1f81a00700 1 -- 172.21.15.5:0/4159178864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f7c1067d0 msgr2=0x7f1f7c106bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.265+0000 7f1f81a00700 1 --2- 172.21.15.5:0/4159178864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f7c1067d0 0x7f1f7c106bb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009910 tx=0x7f1f6c009c20 comp rx=0 tx=0).stop 2024-01-24T15:34:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.265+0000 7f1f81a00700 1 -- 172.21.15.5:0/4159178864 shutdown_connections 2024-01-24T15:34:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.265+0000 7f1f81a00700 1 --2- 172.21.15.5:0/4159178864 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f7c1067d0 0x7f1f7c106bb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.265+0000 7f1f81a00700 1 -- 172.21.15.5:0/4159178864 >> 172.21.15.5:0/4159178864 conn(0x7f1f7c0fc300 msgr2=0x7f1f7c0fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.265+0000 7f1f81a00700 1 -- 172.21.15.5:0/4159178864 shutdown_connections 2024-01-24T15:34:26.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.265+0000 7f1f81a00700 1 -- 172.21.15.5:0/4159178864 wait complete. 2024-01-24T15:34:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.266+0000 7f1f81a00700 1 Processor -- start 2024-01-24T15:34:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.267+0000 7f1f81a00700 1 -- start start 2024-01-24T15:34:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.267+0000 7f1f81a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f7c1067d0 0x7f1f7c197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:26.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.267+0000 7f1f81a00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c198310 con 0x7f1f7c1067d0 2024-01-24T15:34:26.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.267+0000 7f1f7aa00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f7c1067d0 0x7f1f7c197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:26.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.267+0000 7f1f7aa00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f7c1067d0 0x7f1f7c197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53132/0 (socket says 172.21.15.5:53132) 2024-01-24T15:34:26.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.267+0000 7f1f7aa00700 1 -- 172.21.15.5:0/2813751263 learned_addr learned my addr 172.21.15.5:0/2813751263 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:34:26.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.267+0000 7f1f7aa00700 1 -- 172.21.15.5:0/2813751263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6c0095f0 con 0x7f1f7c1067d0 2024-01-24T15:34:26.269 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.268+0000 7f1f7aa00700 1 --2- 172.21.15.5:0/2813751263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f7c1067d0 0x7f1f7c197dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c006010 tx=0x7f1f6c004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.268+0000 7f1f73400700 1 -- 172.21.15.5:0/2813751263 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f6c01d070 con 0x7f1f7c1067d0 2024-01-24T15:34:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.268+0000 7f1f73400700 1 -- 172.21.15.5:0/2813751263 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1f6c00bdf0 con 0x7f1f7c1067d0 2024-01-24T15:34:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.268+0000 7f1f81a00700 1 -- 172.21.15.5:0/2813751263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f7c198570 con 0x7f1f7c1067d0 2024-01-24T15:34:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.268+0000 7f1f73400700 1 -- 172.21.15.5:0/2813751263 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f6c022d80 con 0x7f1f7c1067d0 2024-01-24T15:34:26.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.268+0000 7f1f81a00700 1 -- 172.21.15.5:0/2813751263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f7c1989f0 con 0x7f1f7c1067d0 2024-01-24T15:34:26.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.269+0000 7f1f73400700 1 -- 172.21.15.5:0/2813751263 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45323+0+0 (secure 0 0 0) 0x7f1f6c00b960 con 0x7f1f7c1067d0 2024-01-24T15:34:26.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.269+0000 7f1f81a00700 1 -- 172.21.15.5:0/2813751263 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f7c062370 con 0x7f1f7c1067d0 2024-01-24T15:34:26.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.270+0000 7f1f73400700 1 --2- 172.21.15.5:0/2813751263 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f1f5c0383f0 0x7f1f5c03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:26.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.270+0000 7f1f73400700 1 -- 172.21.15.5:0/2813751263 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1f6c04c3e0 con 0x7f1f7c1067d0 2024-01-24T15:34:26.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.270+0000 7f1f7a000700 1 --2- 172.21.15.5:0/2813751263 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f1f5c0383f0 0x7f1f5c03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:26.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.271+0000 7f1f7a000700 1 --2- 172.21.15.5:0/2813751263 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f1f5c0383f0 0x7f1f5c03a8b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1f64006fd0 tx=0x7f1f64006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:26.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.275+0000 7f1f73400700 1 -- 172.21.15.5:0/2813751263 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f1f6c02bba0 con 0x7f1f7c1067d0 2024-01-24T15:34:26.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.488+0000 7f1f81a00700 1 -- 172.21.15.5:0/2813751263 --> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1f7c073f80 con 0x7f1f5c0383f0 2024-01-24T15:34:26.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.490+0000 7f1f73400700 1 -- 172.21.15.5:0/2813751263 <== mgr.14150 v2:172.21.15.5:6800/1971309753 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7f1f7c073f80 con 0x7f1f5c0383f0 2024-01-24T15:34:26.491 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:34:26.491 INFO:teuthology.orchestra.run.smithi005.stdout:[{"addr": "172.21.15.5", "hostname": "smithi005", "labels": [], "status": ""}, {"addr": "172.21.15.160", "hostname": "smithi160", "labels": [], "status": ""}] 2024-01-24T15:34:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.492+0000 7f1f81a00700 1 -- 172.21.15.5:0/2813751263 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f1f5c0383f0 msgr2=0x7f1f5c03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.492+0000 7f1f81a00700 1 --2- 172.21.15.5:0/2813751263 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f1f5c0383f0 0x7f1f5c03a8b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1f64006fd0 tx=0x7f1f64006e40 comp rx=0 tx=0).stop 2024-01-24T15:34:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.492+0000 7f1f81a00700 1 -- 172.21.15.5:0/2813751263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f7c1067d0 msgr2=0x7f1f7c197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.492+0000 7f1f81a00700 1 --2- 172.21.15.5:0/2813751263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f7c1067d0 0x7f1f7c197dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c006010 tx=0x7f1f6c004ff0 comp rx=0 tx=0).stop 2024-01-24T15:34:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.492+0000 7f1f81a00700 1 -- 172.21.15.5:0/2813751263 shutdown_connections 2024-01-24T15:34:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.492+0000 7f1f81a00700 1 --2- 172.21.15.5:0/2813751263 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f1f5c0383f0 0x7f1f5c03a8b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.492+0000 7f1f81a00700 1 --2- 172.21.15.5:0/2813751263 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1f7c1067d0 0x7f1f7c197dd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.492+0000 7f1f81a00700 1 -- 172.21.15.5:0/2813751263 >> 172.21.15.5:0/2813751263 conn(0x7f1f7c0fc300 msgr2=0x7f1f7c108cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:26.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.492+0000 7f1f81a00700 1 -- 172.21.15.5:0/2813751263 shutdown_connections 2024-01-24T15:34:26.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:26.492+0000 7f1f81a00700 1 -- 172.21.15.5:0/2813751263 wait complete. 2024-01-24T15:34:26.822 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:26 smithi005 ceph-mon[35346]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-24T15:34:26.850 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi204 2024-01-24T15:34:26.850 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-01-24T15:34:26.850 DEBUG:teuthology.orchestra.run.smithi204:> dd of=/etc/ceph/ceph.conf 2024-01-24T15:34:26.896 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-01-24T15:34:26.896 DEBUG:teuthology.orchestra.run.smithi204:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-01-24T15:34:26.980 INFO:tasks.cephadm:Adding host smithi204 to orchestrator... 2024-01-24T15:34:26.980 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph orch host add smithi204 2024-01-24T15:34:27.335 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.a/config 2024-01-24T15:34:27.772 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:27 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:27.772 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:27 smithi005 ceph-mon[35346]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:28.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.440+0000 7f38b6200700 1 -- 172.21.15.5:0/2276034926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38b01067d0 msgr2=0x7f38b0106bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:28.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.440+0000 7f38b6200700 1 --2- 172.21.15.5:0/2276034926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38b01067d0 0x7f38b0106bb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f38a0009910 tx=0x7f38a0009c20 comp rx=0 tx=0).stop 2024-01-24T15:34:28.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.440+0000 7f38b6200700 1 -- 172.21.15.5:0/2276034926 shutdown_connections 2024-01-24T15:34:28.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.440+0000 7f38b6200700 1 --2- 172.21.15.5:0/2276034926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38b01067d0 0x7f38b0106bb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:28.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.440+0000 7f38b6200700 1 -- 172.21.15.5:0/2276034926 >> 172.21.15.5:0/2276034926 conn(0x7f38b00fc300 msgr2=0x7f38b00fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:28.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.440+0000 7f38b6200700 1 -- 172.21.15.5:0/2276034926 shutdown_connections 2024-01-24T15:34:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.440+0000 7f38b6200700 1 -- 172.21.15.5:0/2276034926 wait complete. 2024-01-24T15:34:28.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.441+0000 7f38b6200700 1 Processor -- start 2024-01-24T15:34:28.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.441+0000 7f38b6200700 1 -- start start 2024-01-24T15:34:28.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.442+0000 7f38b6200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38b01067d0 0x7f38b0197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:28.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.442+0000 7f38b6200700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b0198310 con 0x7f38b01067d0 2024-01-24T15:34:28.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.442+0000 7f38af400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38b01067d0 0x7f38b0197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:28.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.442+0000 7f38af400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38b01067d0 0x7f38b0197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53148/0 (socket says 172.21.15.5:53148) 2024-01-24T15:34:28.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.442+0000 7f38af400700 1 -- 172.21.15.5:0/3397378366 learned_addr learned my addr 172.21.15.5:0/3397378366 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:34:28.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.442+0000 7f38af400700 1 -- 172.21.15.5:0/3397378366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a00095f0 con 0x7f38b01067d0 2024-01-24T15:34:28.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.442+0000 7f38af400700 1 --2- 172.21.15.5:0/3397378366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38b01067d0 0x7f38b0197dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f38a0006010 tx=0x7f38a0004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:28.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.443+0000 7f38a7e00700 1 -- 172.21.15.5:0/3397378366 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38a001d070 con 0x7f38b01067d0 2024-01-24T15:34:28.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.443+0000 7f38a7e00700 1 -- 172.21.15.5:0/3397378366 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38a000bdf0 con 0x7f38b01067d0 2024-01-24T15:34:28.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.443+0000 7f38b6200700 1 -- 172.21.15.5:0/3397378366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b0198570 con 0x7f38b01067d0 2024-01-24T15:34:28.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.443+0000 7f38a7e00700 1 -- 172.21.15.5:0/3397378366 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38a0022d80 con 0x7f38b01067d0 2024-01-24T15:34:28.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.443+0000 7f38b6200700 1 -- 172.21.15.5:0/3397378366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b01989f0 con 0x7f38b01067d0 2024-01-24T15:34:28.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.444+0000 7f38a7e00700 1 -- 172.21.15.5:0/3397378366 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45323+0+0 (secure 0 0 0) 0x7f38a000b960 con 0x7f38b01067d0 2024-01-24T15:34:28.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.444+0000 7f38b6200700 1 -- 172.21.15.5:0/3397378366 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b0062370 con 0x7f38b01067d0 2024-01-24T15:34:28.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.444+0000 7f38a7e00700 1 --2- 172.21.15.5:0/3397378366 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f38900383f0 0x7f389003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:28.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.444+0000 7f38a7e00700 1 -- 172.21.15.5:0/3397378366 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f38a004c3e0 con 0x7f38b01067d0 2024-01-24T15:34:28.446 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.445+0000 7f38aea00700 1 --2- 172.21.15.5:0/3397378366 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f38900383f0 0x7f389003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:28.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.445+0000 7f38aea00700 1 --2- 172.21.15.5:0/3397378366 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f38900383f0 0x7f389003a8b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3898006fd0 tx=0x7f3898006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:28.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.450+0000 7f38a7e00700 1 -- 172.21.15.5:0/3397378366 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f38a002bba0 con 0x7f38b01067d0 2024-01-24T15:34:28.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:28.662+0000 7f38b6200700 1 -- 172.21.15.5:0/3397378366 --> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi204", "target": ["mon-mgr", ""]}) v1 -- 0x7f38b0073f80 con 0x7f38900383f0 2024-01-24T15:34:30.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:30 smithi005 ceph-mon[35346]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi204", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:34:30.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:30 smithi005 ceph-mon[35346]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:30.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:30 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:30.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:30 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:30.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:30 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:30.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:30 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:30.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:30 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi160", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:34:30.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:30 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:34:30.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:30 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:34:30.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:30 smithi005 ceph-mon[35346]: Updating smithi160:/etc/ceph/ceph.conf 2024-01-24T15:34:30.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:30 smithi005 ceph-mon[35346]: Deploying cephadm binary to smithi204 2024-01-24T15:34:31.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:31.623+0000 7f38a7e00700 1 -- 172.21.15.5:0/3397378366 <== mgr.14150 v2:172.21.15.5:6800/1971309753 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f38b0073f80 con 0x7f38900383f0 2024-01-24T15:34:31.624 INFO:teuthology.orchestra.run.smithi005.stdout:Added host 'smithi204' with addr '172.21.15.204' 2024-01-24T15:34:31.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:31.625+0000 7f38b6200700 1 -- 172.21.15.5:0/3397378366 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f38900383f0 msgr2=0x7f389003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:31.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:31.625+0000 7f38b6200700 1 --2- 172.21.15.5:0/3397378366 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f38900383f0 0x7f389003a8b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3898006fd0 tx=0x7f3898006e40 comp rx=0 tx=0).stop 2024-01-24T15:34:31.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:31.625+0000 7f38b6200700 1 -- 172.21.15.5:0/3397378366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38b01067d0 msgr2=0x7f38b0197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:31.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:31.625+0000 7f38b6200700 1 --2- 172.21.15.5:0/3397378366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38b01067d0 0x7f38b0197dd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f38a0006010 tx=0x7f38a0004ff0 comp rx=0 tx=0).stop 2024-01-24T15:34:31.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:31.625+0000 7f38b6200700 1 -- 172.21.15.5:0/3397378366 shutdown_connections 2024-01-24T15:34:31.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:31.625+0000 7f38b6200700 1 --2- 172.21.15.5:0/3397378366 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f38900383f0 0x7f389003a8b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:31.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:31.625+0000 7f38b6200700 1 --2- 172.21.15.5:0/3397378366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f38b01067d0 0x7f38b0197dd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:31.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:31.625+0000 7f38b6200700 1 -- 172.21.15.5:0/3397378366 >> 172.21.15.5:0/3397378366 conn(0x7f38b00fc300 msgr2=0x7f38b0108cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:31.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:31.625+0000 7f38b6200700 1 -- 172.21.15.5:0/3397378366 shutdown_connections 2024-01-24T15:34:31.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:31.625+0000 7f38b6200700 1 -- 172.21.15.5:0/3397378366 wait complete. 2024-01-24T15:34:31.649 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:31 smithi005 ceph-mon[35346]: Updating smithi160:/var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/config/ceph.conf 2024-01-24T15:34:32.018 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph orch host ls --format=json 2024-01-24T15:34:32.379 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.a/config 2024-01-24T15:34:32.650 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:32 smithi005 ceph-mon[35346]: Updating smithi160:/etc/ceph/ceph.client.admin.keyring 2024-01-24T15:34:32.650 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:32 smithi005 ceph-mon[35346]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:32.650 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:32.651 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:32.651 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:32.651 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:33.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.417+0000 7fe560a00700 1 -- 172.21.15.5:0/2333301354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c106660 msgr2=0x7fe55c106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:33.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.417+0000 7fe560a00700 1 --2- 172.21.15.5:0/2333301354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c106660 0x7fe55c106a40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe54c009910 tx=0x7fe54c009c20 comp rx=0 tx=0).stop 2024-01-24T15:34:33.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.417+0000 7fe560a00700 1 -- 172.21.15.5:0/2333301354 shutdown_connections 2024-01-24T15:34:33.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.417+0000 7fe560a00700 1 --2- 172.21.15.5:0/2333301354 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c106660 0x7fe55c106a40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:33.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.417+0000 7fe560a00700 1 -- 172.21.15.5:0/2333301354 >> 172.21.15.5:0/2333301354 conn(0x7fe55c0fc0e0 msgr2=0x7fe55c0fe500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:33.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.417+0000 7fe560a00700 1 -- 172.21.15.5:0/2333301354 shutdown_connections 2024-01-24T15:34:33.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.417+0000 7fe560a00700 1 -- 172.21.15.5:0/2333301354 wait complete. 2024-01-24T15:34:33.419 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.418+0000 7fe560a00700 1 Processor -- start 2024-01-24T15:34:33.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.418+0000 7fe560a00700 1 -- start start 2024-01-24T15:34:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.418+0000 7fe560a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c106660 0x7fe55c19d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.418+0000 7fe560a00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55c19dea0 con 0x7fe55c106660 2024-01-24T15:34:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.419+0000 7fe55b400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c106660 0x7fe55c19d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:33.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.419+0000 7fe55b400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c106660 0x7fe55c19d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38402/0 (socket says 172.21.15.5:38402) 2024-01-24T15:34:33.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.419+0000 7fe55b400700 1 -- 172.21.15.5:0/596124562 learned_addr learned my addr 172.21.15.5:0/596124562 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:34:33.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.419+0000 7fe55b400700 1 -- 172.21.15.5:0/596124562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54c0095f0 con 0x7fe55c106660 2024-01-24T15:34:33.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.419+0000 7fe55b400700 1 --2- 172.21.15.5:0/596124562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c106660 0x7fe55c19d960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe54c005950 tx=0x7fe54c004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:33.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.420+0000 7fe553e00700 1 -- 172.21.15.5:0/596124562 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe54c01d070 con 0x7fe55c106660 2024-01-24T15:34:33.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.420+0000 7fe553e00700 1 -- 172.21.15.5:0/596124562 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe54c00bdf0 con 0x7fe55c106660 2024-01-24T15:34:33.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.420+0000 7fe553e00700 1 -- 172.21.15.5:0/596124562 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe54c022c50 con 0x7fe55c106660 2024-01-24T15:34:33.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.420+0000 7fe560a00700 1 -- 172.21.15.5:0/596124562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55c19e100 con 0x7fe55c106660 2024-01-24T15:34:33.422 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.420+0000 7fe560a00700 1 -- 172.21.15.5:0/596124562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55c1979e0 con 0x7fe55c106660 2024-01-24T15:34:33.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.421+0000 7fe553e00700 1 -- 172.21.15.5:0/596124562 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45323+0+0 (secure 0 0 0) 0x7fe54c022470 con 0x7fe55c106660 2024-01-24T15:34:33.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.421+0000 7fe560a00700 1 -- 172.21.15.5:0/596124562 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe55c062370 con 0x7fe55c106660 2024-01-24T15:34:33.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.421+0000 7fe553e00700 1 --2- 172.21.15.5:0/596124562 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fe53c0383f0 0x7fe53c03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:33.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.421+0000 7fe553e00700 1 -- 172.21.15.5:0/596124562 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe54c04c640 con 0x7fe55c106660 2024-01-24T15:34:33.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.421+0000 7fe55aa00700 1 --2- 172.21.15.5:0/596124562 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fe53c0383f0 0x7fe53c03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:33.423 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.422+0000 7fe55aa00700 1 --2- 172.21.15.5:0/596124562 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fe53c0383f0 0x7fe53c03a8b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe544006fd0 tx=0x7fe544006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:33.430 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.429+0000 7fe553e00700 1 -- 172.21.15.5:0/596124562 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7fe54c02bba0 con 0x7fe55c106660 2024-01-24T15:34:33.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.641+0000 7fe560a00700 1 -- 172.21.15.5:0/596124562 --> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe55c198410 con 0x7fe53c0383f0 2024-01-24T15:34:33.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.642+0000 7fe553e00700 1 -- 172.21.15.5:0/596124562 <== mgr.14150 v2:172.21.15.5:6800/1971309753 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+239 (secure 0 0 0) 0x7fe55c198410 con 0x7fe53c0383f0 2024-01-24T15:34:33.644 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:34:33.644 INFO:teuthology.orchestra.run.smithi005.stdout:[{"addr": "172.21.15.5", "hostname": "smithi005", "labels": [], "status": ""}, {"addr": "172.21.15.160", "hostname": "smithi160", "labels": [], "status": ""}, {"addr": "172.21.15.204", "hostname": "smithi204", "labels": [], "status": ""}] 2024-01-24T15:34:33.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.644+0000 7fe560a00700 1 -- 172.21.15.5:0/596124562 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fe53c0383f0 msgr2=0x7fe53c03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:33.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.644+0000 7fe560a00700 1 --2- 172.21.15.5:0/596124562 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fe53c0383f0 0x7fe53c03a8b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe544006fd0 tx=0x7fe544006e40 comp rx=0 tx=0).stop 2024-01-24T15:34:33.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.644+0000 7fe560a00700 1 -- 172.21.15.5:0/596124562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c106660 msgr2=0x7fe55c19d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:33.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.644+0000 7fe560a00700 1 --2- 172.21.15.5:0/596124562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c106660 0x7fe55c19d960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe54c005950 tx=0x7fe54c004ff0 comp rx=0 tx=0).stop 2024-01-24T15:34:33.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.645+0000 7fe560a00700 1 -- 172.21.15.5:0/596124562 shutdown_connections 2024-01-24T15:34:33.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.645+0000 7fe560a00700 1 --2- 172.21.15.5:0/596124562 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fe53c0383f0 0x7fe53c03a8b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:33.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.645+0000 7fe560a00700 1 --2- 172.21.15.5:0/596124562 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe55c106660 0x7fe55c19d960 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:33.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.645+0000 7fe560a00700 1 -- 172.21.15.5:0/596124562 >> 172.21.15.5:0/596124562 conn(0x7fe55c0fc0e0 msgr2=0x7fe55c0fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:33.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.645+0000 7fe560a00700 1 -- 172.21.15.5:0/596124562 shutdown_connections 2024-01-24T15:34:33.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:33.645+0000 7fe560a00700 1 -- 172.21.15.5:0/596124562 wait complete. 2024-01-24T15:34:33.667 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:33 smithi005 ceph-mon[35346]: Updating smithi160:/var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/config/ceph.client.admin.keyring 2024-01-24T15:34:33.667 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:33 smithi005 ceph-mon[35346]: Added host smithi204 2024-01-24T15:34:33.667 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:33 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:34:33.668 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:33 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:33.668 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:33 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:34.017 INFO:tasks.cephadm:Setting crush tunables to default 2024-01-24T15:34:34.017 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph osd crush tunables default 2024-01-24T15:34:34.370 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.a/config 2024-01-24T15:34:34.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:34 smithi005 ceph-mon[35346]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:35.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.398+0000 7f1ebca00700 1 -- 172.21.15.5:0/1823514432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1eb8106660 msgr2=0x7f1eb8106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:35.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.398+0000 7f1ebca00700 1 --2- 172.21.15.5:0/1823514432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1eb8106660 0x7f1eb8106a40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8009910 tx=0x7f1ea8009c20 comp rx=0 tx=0).stop 2024-01-24T15:34:35.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.398+0000 7f1ebca00700 1 -- 172.21.15.5:0/1823514432 shutdown_connections 2024-01-24T15:34:35.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.398+0000 7f1ebca00700 1 --2- 172.21.15.5:0/1823514432 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1eb8106660 0x7f1eb8106a40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:35.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.398+0000 7f1ebca00700 1 -- 172.21.15.5:0/1823514432 >> 172.21.15.5:0/1823514432 conn(0x7f1eb80fc0e0 msgr2=0x7f1eb80fe500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:35.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.398+0000 7f1ebca00700 1 -- 172.21.15.5:0/1823514432 shutdown_connections 2024-01-24T15:34:35.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.398+0000 7f1ebca00700 1 -- 172.21.15.5:0/1823514432 wait complete. 2024-01-24T15:34:35.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.399+0000 7f1ebca00700 1 Processor -- start 2024-01-24T15:34:35.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.399+0000 7f1ebca00700 1 -- start start 2024-01-24T15:34:35.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.400+0000 7f1ebca00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1eb8106660 0x7f1eb8195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:35.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.400+0000 7f1ebca00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb8195ec0 con 0x7f1eb8106660 2024-01-24T15:34:35.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.400+0000 7f1eb6800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1eb8106660 0x7f1eb8195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:35.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.400+0000 7f1eb6800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1eb8106660 0x7f1eb8195980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38424/0 (socket says 172.21.15.5:38424) 2024-01-24T15:34:35.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.400+0000 7f1eb6800700 1 -- 172.21.15.5:0/1399809391 learned_addr learned my addr 172.21.15.5:0/1399809391 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:34:35.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.400+0000 7f1eb6800700 1 -- 172.21.15.5:0/1399809391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea80095f0 con 0x7f1eb8106660 2024-01-24T15:34:35.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.400+0000 7f1eb6800700 1 --2- 172.21.15.5:0/1399809391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1eb8106660 0x7f1eb8195980 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8005950 tx=0x7f1ea8004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:35.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.401+0000 7f1eaf400700 1 -- 172.21.15.5:0/1399809391 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ea801d070 con 0x7f1eb8106660 2024-01-24T15:34:35.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.401+0000 7f1eaf400700 1 -- 172.21.15.5:0/1399809391 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1ea800bdf0 con 0x7f1eb8106660 2024-01-24T15:34:35.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.401+0000 7f1ebca00700 1 -- 172.21.15.5:0/1399809391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb8196120 con 0x7f1eb8106660 2024-01-24T15:34:35.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.401+0000 7f1eaf400700 1 -- 172.21.15.5:0/1399809391 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ea8022c50 con 0x7f1eb8106660 2024-01-24T15:34:35.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.401+0000 7f1ebca00700 1 -- 172.21.15.5:0/1399809391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb8196620 con 0x7f1eb8106660 2024-01-24T15:34:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.402+0000 7f1eaf400700 1 -- 172.21.15.5:0/1399809391 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45323+0+0 (secure 0 0 0) 0x7f1ea8022470 con 0x7f1eb8106660 2024-01-24T15:34:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.402+0000 7f1ebca00700 1 -- 172.21.15.5:0/1399809391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb8062370 con 0x7f1eb8106660 2024-01-24T15:34:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.402+0000 7f1eaf400700 1 --2- 172.21.15.5:0/1399809391 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f1e980383f0 0x7f1e9803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.403+0000 7f1eaf400700 1 -- 172.21.15.5:0/1399809391 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1ea804c3a0 con 0x7f1eb8106660 2024-01-24T15:34:35.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.403+0000 7f1eb5e00700 1 --2- 172.21.15.5:0/1399809391 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f1e980383f0 0x7f1e9803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:35.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.403+0000 7f1eb5e00700 1 --2- 172.21.15.5:0/1399809391 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f1e980383f0 0x7f1e9803a8b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0006fd0 tx=0x7f1ea0006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:35.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.407+0000 7f1eaf400700 1 -- 172.21.15.5:0/1399809391 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f1ea802b590 con 0x7f1eb8106660 2024-01-24T15:34:35.432 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:35 smithi005 ceph-mon[35346]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-24T15:34:35.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:35 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:35.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:35.622+0000 7f1ebca00700 1 -- 172.21.15.5:0/1399809391 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f1eb8196620 con 0x7f1eb8106660 2024-01-24T15:34:36.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:36.588+0000 7f1eaf400700 1 -- 172.21.15.5:0/1399809391 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f1eb8196620 con 0x7f1eb8106660 2024-01-24T15:34:36.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:36.591+0000 7f1ebca00700 1 -- 172.21.15.5:0/1399809391 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f1e980383f0 msgr2=0x7f1e9803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:36.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:36.591+0000 7f1ebca00700 1 --2- 172.21.15.5:0/1399809391 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f1e980383f0 0x7f1e9803a8b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0006fd0 tx=0x7f1ea0006e40 comp rx=0 tx=0).stop 2024-01-24T15:34:36.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:36.591+0000 7f1ebca00700 1 -- 172.21.15.5:0/1399809391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1eb8106660 msgr2=0x7f1eb8195980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:36.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:36.591+0000 7f1ebca00700 1 --2- 172.21.15.5:0/1399809391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1eb8106660 0x7f1eb8195980 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8005950 tx=0x7f1ea8004ff0 comp rx=0 tx=0).stop 2024-01-24T15:34:36.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:36.591+0000 7f1ebca00700 1 -- 172.21.15.5:0/1399809391 shutdown_connections 2024-01-24T15:34:36.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:36.591+0000 7f1ebca00700 1 --2- 172.21.15.5:0/1399809391 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f1e980383f0 0x7f1e9803a8b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:36.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:36.591+0000 7f1ebca00700 1 --2- 172.21.15.5:0/1399809391 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1eb8106660 0x7f1eb8195980 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:36.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:36.591+0000 7f1ebca00700 1 -- 172.21.15.5:0/1399809391 >> 172.21.15.5:0/1399809391 conn(0x7f1eb80fc0e0 msgr2=0x7f1eb80fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:36.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:36.592+0000 7f1ebca00700 1 -- 172.21.15.5:0/1399809391 shutdown_connections 2024-01-24T15:34:36.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:34:36.592+0000 7f1ebca00700 1 -- 172.21.15.5:0/1399809391 wait complete. 2024-01-24T15:34:36.594 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2024-01-24T15:34:36.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:36 smithi005 ceph-mon[35346]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:36.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:36 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/1399809391' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-01-24T15:34:36.966 INFO:tasks.cephadm:Adding mon.a on smithi005 2024-01-24T15:34:36.967 INFO:tasks.cephadm:Adding mon.b on smithi160 2024-01-24T15:34:36.967 INFO:tasks.cephadm:Adding mon.c on smithi204 2024-01-24T15:34:36.967 DEBUG:teuthology.orchestra.run.smithi204:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph orch apply mon '3;smithi005:172.21.15.5=a;smithi160:172.21.15.160=b;smithi204:172.21.15.204=c' 2024-01-24T15:34:37.344 INFO:teuthology.orchestra.run.smithi204.stderr:Inferring config /etc/ceph/ceph.conf 2024-01-24T15:34:37.837 INFO:teuthology.orchestra.run.smithi204.stderr:Inferring config /etc/ceph/ceph.conf 2024-01-24T15:34:37.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:37 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/1399809391' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-01-24T15:34:37.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:37 smithi005 ceph-mon[35346]: osdmap e4: 0 total, 0 up, 0 in 2024-01-24T15:34:37.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:37 smithi005 ceph-mon[35346]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:39.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:38 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:39.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:38 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:39.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:38 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:39.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:38 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:39.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:38 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi204", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:34:39.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:38 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:34:39.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:38 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:34:39.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:38 smithi005 ceph-mon[35346]: Updating smithi204:/etc/ceph/ceph.conf 2024-01-24T15:34:39.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:38 smithi005 ceph-mon[35346]: Updating smithi204:/var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/config/ceph.conf 2024-01-24T15:34:39.199 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.197+0000 7f35ce800700 1 -- 172.21.15.204:0/739191879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35c80ff730 msgr2=0x7f35c80ffb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:39.199 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.197+0000 7f35ce800700 1 --2- 172.21.15.204:0/739191879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35c80ff730 0x7f35c80ffb50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009910 tx=0x7f35b8009c20 comp rx=0 tx=0).stop 2024-01-24T15:34:39.199 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.197+0000 7f35ce800700 1 -- 172.21.15.204:0/739191879 shutdown_connections 2024-01-24T15:34:39.199 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.197+0000 7f35ce800700 1 --2- 172.21.15.204:0/739191879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35c80ff730 0x7f35c80ffb50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:39.199 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.197+0000 7f35ce800700 1 -- 172.21.15.204:0/739191879 >> 172.21.15.204:0/739191879 conn(0x7f35c80facd0 msgr2=0x7f35c80fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:39.199 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.197+0000 7f35ce800700 1 -- 172.21.15.204:0/739191879 shutdown_connections 2024-01-24T15:34:39.199 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.197+0000 7f35ce800700 1 -- 172.21.15.204:0/739191879 wait complete. 2024-01-24T15:34:39.200 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.199+0000 7f35ce800700 1 Processor -- start 2024-01-24T15:34:39.200 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.199+0000 7f35ce800700 1 -- start start 2024-01-24T15:34:39.201 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.199+0000 7f35ce800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35c80ff730 0x7f35c80fccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:39.201 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.199+0000 7f35ce800700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c80fd1f0 con 0x7f35c80ff730 2024-01-24T15:34:39.201 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.200+0000 7f35c7400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35c80ff730 0x7f35c80fccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:39.201 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.200+0000 7f35c7400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35c80ff730 0x7f35c80fccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.204:36472/0 (socket says 172.21.15.204:36472) 2024-01-24T15:34:39.201 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.200+0000 7f35c7400700 1 -- 172.21.15.204:0/1206171101 learned_addr learned my addr 172.21.15.204:0/1206171101 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-01-24T15:34:39.202 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.200+0000 7f35c7400700 1 -- 172.21.15.204:0/1206171101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b80095f0 con 0x7f35c80ff730 2024-01-24T15:34:39.202 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.200+0000 7f35c7400700 1 --2- 172.21.15.204:0/1206171101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35c80ff730 0x7f35c80fccb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f35b8005950 tx=0x7f35b8005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:39.203 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.201+0000 7f35c4c00700 1 -- 172.21.15.204:0/1206171101 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35b800ba90 con 0x7f35c80ff730 2024-01-24T15:34:39.203 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.201+0000 7f35ce800700 1 -- 172.21.15.204:0/1206171101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c80fb300 con 0x7f35c80ff730 2024-01-24T15:34:39.203 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.201+0000 7f35c4c00700 1 -- 172.21.15.204:0/1206171101 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f35b800bbf0 con 0x7f35c80ff730 2024-01-24T15:34:39.203 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.201+0000 7f35c4c00700 1 -- 172.21.15.204:0/1206171101 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35b8017440 con 0x7f35c80ff730 2024-01-24T15:34:39.203 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.201+0000 7f35ce800700 1 -- 172.21.15.204:0/1206171101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c80fb7a0 con 0x7f35c80ff730 2024-01-24T15:34:39.203 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.202+0000 7f35ce800700 1 -- 172.21.15.204:0/1206171101 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c8062370 con 0x7f35c80ff730 2024-01-24T15:34:39.204 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.202+0000 7f35c4c00700 1 -- 172.21.15.204:0/1206171101 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45323+0+0 (secure 0 0 0) 0x7f35b800f460 con 0x7f35c80ff730 2024-01-24T15:34:39.205 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.203+0000 7f35c4c00700 1 --2- 172.21.15.204:0/1206171101 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f35a80383a0 0x7f35a803a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:39.205 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.203+0000 7f35c4c00700 1 -- 172.21.15.204:0/1206171101 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f35b804c5a0 con 0x7f35c80ff730 2024-01-24T15:34:39.205 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.203+0000 7f35bfe00700 1 --2- 172.21.15.204:0/1206171101 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f35a80383a0 0x7f35a803a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:39.205 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.204+0000 7f35bfe00700 1 --2- 172.21.15.204:0/1206171101 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f35a80383a0 0x7f35a803a860 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f35b0006fd0 tx=0x7f35b0006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:39.210 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.209+0000 7f35c4c00700 1 -- 172.21.15.204:0/1206171101 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f35b8015350 con 0x7f35c80ff730 2024-01-24T15:34:39.433 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.432+0000 7f35ce800700 1 -- 172.21.15.204:0/1206171101 --> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi005:172.21.15.5=a;smithi160:172.21.15.160=b;smithi204:172.21.15.204=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f35c80fbb60 con 0x7f35a80383a0 2024-01-24T15:34:39.441 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.439+0000 7f35c4c00700 1 -- 172.21.15.204:0/1206171101 <== mgr.14150 v2:172.21.15.5:6800/1971309753 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f35c80fbb60 con 0x7f35a80383a0 2024-01-24T15:34:39.441 INFO:teuthology.orchestra.run.smithi204.stdout:Scheduled mon update... 2024-01-24T15:34:39.443 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.442+0000 7f35ce800700 1 -- 172.21.15.204:0/1206171101 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f35a80383a0 msgr2=0x7f35a803a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:39.444 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.442+0000 7f35ce800700 1 --2- 172.21.15.204:0/1206171101 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f35a80383a0 0x7f35a803a860 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f35b0006fd0 tx=0x7f35b0006e40 comp rx=0 tx=0).stop 2024-01-24T15:34:39.444 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.442+0000 7f35ce800700 1 -- 172.21.15.204:0/1206171101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35c80ff730 msgr2=0x7f35c80fccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:39.444 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.442+0000 7f35ce800700 1 --2- 172.21.15.204:0/1206171101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35c80ff730 0x7f35c80fccb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f35b8005950 tx=0x7f35b8005810 comp rx=0 tx=0).stop 2024-01-24T15:34:39.444 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.442+0000 7f35ce800700 1 -- 172.21.15.204:0/1206171101 shutdown_connections 2024-01-24T15:34:39.444 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.442+0000 7f35ce800700 1 --2- 172.21.15.204:0/1206171101 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f35a80383a0 0x7f35a803a860 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:39.444 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.442+0000 7f35ce800700 1 --2- 172.21.15.204:0/1206171101 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f35c80ff730 0x7f35c80fccb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:39.444 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.442+0000 7f35ce800700 1 -- 172.21.15.204:0/1206171101 >> 172.21.15.204:0/1206171101 conn(0x7f35c80facd0 msgr2=0x7f35c80687d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:39.444 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.442+0000 7f35ce800700 1 -- 172.21.15.204:0/1206171101 shutdown_connections 2024-01-24T15:34:39.444 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:39.442+0000 7f35ce800700 1 -- 172.21.15.204:0/1206171101 wait complete. 2024-01-24T15:34:39.937 DEBUG:teuthology.orchestra.run.smithi160:mon.b> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mon.b.service 2024-01-24T15:34:39.942 DEBUG:teuthology.orchestra.run.smithi204:mon.c> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mon.c.service 2024-01-24T15:34:39.946 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-01-24T15:34:39.946 DEBUG:teuthology.orchestra.run.smithi204:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph mon dump -f json 2024-01-24T15:34:40.017 INFO:journalctl@ceph.mon.b.smithi160.stdout:-- Logs begin at Wed 2024-01-24 15:17:12 UTC. -- 2024-01-24T15:34:40.017 INFO:journalctl@ceph.mon.c.smithi204.stdout:-- Logs begin at Wed 2024-01-24 15:17:05 UTC. -- 2024-01-24T15:34:40.379 INFO:teuthology.orchestra.run.smithi204.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/config/ceph.conf 2024-01-24T15:34:40.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:40 smithi005 ceph-mon[35346]: Updating smithi204:/etc/ceph/ceph.client.admin.keyring 2024-01-24T15:34:40.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:40 smithi005 ceph-mon[35346]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:40.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:40 smithi005 ceph-mon[35346]: Updating smithi204:/var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/config/ceph.client.admin.keyring 2024-01-24T15:34:40.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:40 smithi005 ceph-mon[35346]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi005:172.21.15.5=a;smithi160:172.21.15.160=b;smithi204:172.21.15.204=c", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:34:40.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:40 smithi005 ceph-mon[35346]: Saving service mon spec with placement smithi005:172.21.15.5=a;smithi160:172.21.15.160=b;smithi204:172.21.15.204=c;count:3 2024-01-24T15:34:40.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:40 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:40.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:40 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:40.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:40 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:40.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:40 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:40.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:40 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-24T15:34:40.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:40 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:34:41.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:41 smithi005 ceph-mon[35346]: Deploying daemon mon.c on smithi204 2024-01-24T15:34:42.491 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.488+0000 7fbb0be00700 1 -- 172.21.15.204:0/2339229402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb0c106660 msgr2=0x7fbb0c106a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:42.492 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.488+0000 7fbb0be00700 1 --2- 172.21.15.204:0/2339229402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb0c106660 0x7fbb0c106a40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbafc009910 tx=0x7fbafc009c20 comp rx=0 tx=0).stop 2024-01-24T15:34:42.492 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.489+0000 7fbb0be00700 1 -- 172.21.15.204:0/2339229402 shutdown_connections 2024-01-24T15:34:42.492 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.489+0000 7fbb0be00700 1 --2- 172.21.15.204:0/2339229402 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb0c106660 0x7fbb0c106a40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:42.492 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.489+0000 7fbb0be00700 1 -- 172.21.15.204:0/2339229402 >> 172.21.15.204:0/2339229402 conn(0x7fbb0c0fc0e0 msgr2=0x7fbb0c0fe500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:42.492 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.489+0000 7fbb0be00700 1 -- 172.21.15.204:0/2339229402 shutdown_connections 2024-01-24T15:34:42.492 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.489+0000 7fbb0be00700 1 -- 172.21.15.204:0/2339229402 wait complete. 2024-01-24T15:34:42.492 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.490+0000 7fbb0be00700 1 Processor -- start 2024-01-24T15:34:42.492 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.490+0000 7fbb0be00700 1 -- start start 2024-01-24T15:34:42.493 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.490+0000 7fbb0be00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb0c106660 0x7fbb0c19d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:42.493 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.490+0000 7fbb0be00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c19def0 con 0x7fbb0c106660 2024-01-24T15:34:42.494 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.490+0000 7fbb0aa00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb0c106660 0x7fbb0c19d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:42.494 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.490+0000 7fbb0aa00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb0c106660 0x7fbb0c19d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.204:36478/0 (socket says 172.21.15.204:36478) 2024-01-24T15:34:42.494 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.490+0000 7fbb0aa00700 1 -- 172.21.15.204:0/3119591455 learned_addr learned my addr 172.21.15.204:0/3119591455 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-01-24T15:34:42.494 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.491+0000 7fbb0aa00700 1 -- 172.21.15.204:0/3119591455 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbafc0095f0 con 0x7fbb0c106660 2024-01-24T15:34:42.494 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.491+0000 7fbb0aa00700 1 --2- 172.21.15.204:0/3119591455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb0c106660 0x7fbb0c19d9b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbafc005950 tx=0x7fbafc004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:42.494 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.491+0000 7fbb03400700 1 -- 172.21.15.204:0/3119591455 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbafc01d070 con 0x7fbb0c106660 2024-01-24T15:34:42.494 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.491+0000 7fbb0be00700 1 -- 172.21.15.204:0/3119591455 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb0c19e150 con 0x7fbb0c106660 2024-01-24T15:34:42.494 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.491+0000 7fbb03400700 1 -- 172.21.15.204:0/3119591455 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbafc00bdf0 con 0x7fbb0c106660 2024-01-24T15:34:42.494 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.491+0000 7fbb03400700 1 -- 172.21.15.204:0/3119591455 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbafc022c50 con 0x7fbb0c106660 2024-01-24T15:34:42.494 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.492+0000 7fbb0be00700 1 -- 172.21.15.204:0/3119591455 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0c1979a0 con 0x7fbb0c106660 2024-01-24T15:34:42.495 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.493+0000 7fbb0be00700 1 -- 172.21.15.204:0/3119591455 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb0c062370 con 0x7fbb0c106660 2024-01-24T15:34:42.495 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.493+0000 7fbb03400700 1 -- 172.21.15.204:0/3119591455 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45323+0+0 (secure 0 0 0) 0x7fbafc022470 con 0x7fbb0c106660 2024-01-24T15:34:42.496 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.493+0000 7fbb03400700 1 --2- 172.21.15.204:0/3119591455 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fbaec0383a0 0x7fbaec03a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:42.496 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.493+0000 7fbb03400700 1 -- 172.21.15.204:0/3119591455 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fbafc04c5a0 con 0x7fbb0c106660 2024-01-24T15:34:42.496 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.494+0000 7fbb0a000700 1 --2- 172.21.15.204:0/3119591455 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fbaec0383a0 0x7fbaec03a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:42.496 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.494+0000 7fbb0a000700 1 --2- 172.21.15.204:0/3119591455 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fbaec0383a0 0x7fbaec03a860 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4006fd0 tx=0x7fbaf4006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:42.500 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.499+0000 7fbb03400700 1 -- 172.21.15.204:0/3119591455 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7fbafc02bba0 con 0x7fbb0c106660 2024-01-24T15:34:42.782 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.780+0000 7fbb0be00700 1 -- 172.21.15.204:0/3119591455 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbb0c197c30 con 0x7fbb0c106660 2024-01-24T15:34:42.782 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.781+0000 7fbb03400700 1 -- 172.21.15.204:0/3119591455 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+732 (secure 0 0 0) 0x7fbafc027020 con 0x7fbb0c106660 2024-01-24T15:34:42.783 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-01-24T15:34:42.783 INFO:teuthology.orchestra.run.smithi204.stdout:{"epoch":1,"fsid":"bede0bb6-bacd-11ee-95b1-87774f69a715","modified":"2024-01-24T15:33:10.895521Z","created":"2024-01-24T15:33:10.895521Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-01-24T15:34:42.786 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.783+0000 7fbb0be00700 1 -- 172.21.15.204:0/3119591455 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fbaec0383a0 msgr2=0x7fbaec03a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:42.786 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.783+0000 7fbb0be00700 1 --2- 172.21.15.204:0/3119591455 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fbaec0383a0 0x7fbaec03a860 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4006fd0 tx=0x7fbaf4006e40 comp rx=0 tx=0).stop 2024-01-24T15:34:42.786 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.783+0000 7fbb0be00700 1 -- 172.21.15.204:0/3119591455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb0c106660 msgr2=0x7fbb0c19d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:42.786 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.783+0000 7fbb0be00700 1 --2- 172.21.15.204:0/3119591455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb0c106660 0x7fbb0c19d9b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbafc005950 tx=0x7fbafc004ff0 comp rx=0 tx=0).stop 2024-01-24T15:34:42.786 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.783+0000 7fbb0be00700 1 -- 172.21.15.204:0/3119591455 shutdown_connections 2024-01-24T15:34:42.786 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.783+0000 7fbb0be00700 1 --2- 172.21.15.204:0/3119591455 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fbaec0383a0 0x7fbaec03a860 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:42.786 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.783+0000 7fbb0be00700 1 --2- 172.21.15.204:0/3119591455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbb0c106660 0x7fbb0c19d9b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:42.786 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.783+0000 7fbb0be00700 1 -- 172.21.15.204:0/3119591455 >> 172.21.15.204:0/3119591455 conn(0x7fbb0c0fc0e0 msgr2=0x7fbb0c072f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:42.786 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.784+0000 7fbb0be00700 1 -- 172.21.15.204:0/3119591455 shutdown_connections 2024-01-24T15:34:42.786 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:42.784+0000 7fbb0be00700 1 -- 172.21.15.204:0/3119591455 wait complete. 2024-01-24T15:34:42.787 INFO:teuthology.orchestra.run.smithi204.stderr:dumped monmap epoch 1 2024-01-24T15:34:42.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:42 smithi005 ceph-mon[35346]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:43.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:43 smithi005 ceph-mon[35346]: from='client.? 172.21.15.204:0/3119591455' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-24T15:34:44.305 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-01-24T15:34:44.305 DEBUG:teuthology.orchestra.run.smithi204:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph mon dump -f json 2024-01-24T15:34:44.623 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: set uid:gid to 167:167 (ceph:ceph) 2024-01-24T15:34:44.772 INFO:teuthology.orchestra.run.smithi204.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.c/config 2024-01-24T15:34:44.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:44 smithi005 ceph-mon[35346]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:44.968 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: ceph version 18.2.1-341-g4e3182a6 (4e3182a65800aed6d4aa2f6b86da3cfd72188134) reef (stable), process ceph-mon, pid 7 2024-01-24T15:34:44.969 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: pidfile_write: ignore empty --pid-file 2024-01-24T15:34:44.969 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 bash[39562]: cfaf531bc1248d2a04f6e198b1320fc35ee694b1e8ca6b6753171dcd1c16fd00 2024-01-24T15:34:44.969 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: load: jerasure load: lrc 2024-01-24T15:34:44.969 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: RocksDB version: 7.9.2 2024-01-24T15:34:44.969 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Git sha 0 2024-01-24T15:34:44.969 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Compile date 2024-01-24 06:39:28 2024-01-24T15:34:44.969 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: DB SUMMARY 2024-01-24T15:34:44.969 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: DB Session ID: THQ3E6CXHF13LT8X392I 2024-01-24T15:34:44.969 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: CURRENT file: CURRENT 2024-01-24T15:34:44.969 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: IDENTITY file: IDENTITY 2024-01-24T15:34:44.969 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-01-24T15:34:44.969 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-01-24T15:34:44.969 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-01-24T15:34:44.970 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.error_if_exists: 0 2024-01-24T15:34:44.970 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.create_if_missing: 0 2024-01-24T15:34:44.970 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.paranoid_checks: 1 2024-01-24T15:34:44.970 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.flush_verify_memtable_count: 1 2024-01-24T15:34:44.970 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-01-24T15:34:44.970 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-01-24T15:34:44.970 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.env: 0x5616dc00a720 2024-01-24T15:34:44.970 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.fs: PosixFileSystem 2024-01-24T15:34:44.970 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.info_log: 0x5616ded8d460 2024-01-24T15:34:44.970 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_file_opening_threads: 16 2024-01-24T15:34:44.970 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.statistics: (nil) 2024-01-24T15:34:44.970 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.use_fsync: 0 2024-01-24T15:34:44.970 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_log_file_size: 0 2024-01-24T15:34:44.971 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-01-24T15:34:44.971 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.log_file_time_to_roll: 0 2024-01-24T15:34:44.971 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.keep_log_file_num: 1000 2024-01-24T15:34:44.971 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.recycle_log_file_num: 0 2024-01-24T15:34:44.971 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.allow_fallocate: 1 2024-01-24T15:34:44.971 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.allow_mmap_reads: 0 2024-01-24T15:34:44.971 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.allow_mmap_writes: 0 2024-01-24T15:34:44.971 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.use_direct_reads: 0 2024-01-24T15:34:44.971 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-01-24T15:34:44.971 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.create_missing_column_families: 0 2024-01-24T15:34:44.971 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.db_log_dir: 2024-01-24T15:34:44.971 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.wal_dir: 2024-01-24T15:34:44.971 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.table_cache_numshardbits: 6 2024-01-24T15:34:44.971 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.WAL_ttl_seconds: 0 2024-01-24T15:34:44.972 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.WAL_size_limit_MB: 0 2024-01-24T15:34:44.972 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-01-24T15:34:44.972 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-01-24T15:34:44.972 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.is_fd_close_on_exec: 1 2024-01-24T15:34:44.972 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.advise_random_on_open: 1 2024-01-24T15:34:44.972 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.db_write_buffer_size: 0 2024-01-24T15:34:44.972 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.write_buffer_manager: 0x5616de01e320 2024-01-24T15:34:44.972 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-01-24T15:34:44.972 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-01-24T15:34:44.972 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.use_adaptive_mutex: 0 2024-01-24T15:34:44.972 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.rate_limiter: (nil) 2024-01-24T15:34:44.972 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-01-24T15:34:44.972 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.wal_recovery_mode: 2 2024-01-24T15:34:44.972 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.enable_thread_tracking: 0 2024-01-24T15:34:44.973 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.enable_pipelined_write: 0 2024-01-24T15:34:44.973 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.unordered_write: 0 2024-01-24T15:34:44.973 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-01-24T15:34:44.973 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-01-24T15:34:44.973 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-01-24T15:34:44.973 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-01-24T15:34:44.973 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.row_cache: None 2024-01-24T15:34:44.973 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.wal_filter: None 2024-01-24T15:34:44.973 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-01-24T15:34:44.973 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.allow_ingest_behind: 0 2024-01-24T15:34:44.973 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.two_write_queues: 0 2024-01-24T15:34:44.973 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.manual_wal_flush: 0 2024-01-24T15:34:44.973 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.wal_compression: 0 2024-01-24T15:34:44.973 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.atomic_flush: 0 2024-01-24T15:34:44.974 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-01-24T15:34:44.974 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.persist_stats_to_disk: 0 2024-01-24T15:34:44.974 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.write_dbid_to_manifest: 0 2024-01-24T15:34:44.974 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.log_readahead_size: 0 2024-01-24T15:34:44.974 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-01-24T15:34:44.974 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.best_efforts_recovery: 0 2024-01-24T15:34:44.974 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-01-24T15:34:44.974 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-01-24T15:34:44.974 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.allow_data_in_errors: 0 2024-01-24T15:34:44.974 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.db_host_id: __hostname__ 2024-01-24T15:34:44.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.enforce_single_del_contracts: true 2024-01-24T15:34:44.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_background_jobs: 2 2024-01-24T15:34:44.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_background_compactions: -1 2024-01-24T15:34:44.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_subcompactions: 1 2024-01-24T15:34:44.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-01-24T15:34:44.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-01-24T15:34:44.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.delayed_write_rate : 16777216 2024-01-24T15:34:44.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_total_wal_size: 0 2024-01-24T15:34:44.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-01-24T15:34:44.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.stats_dump_period_sec: 600 2024-01-24T15:34:44.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.stats_persist_period_sec: 600 2024-01-24T15:34:44.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-01-24T15:34:44.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_open_files: -1 2024-01-24T15:34:44.977 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.bytes_per_sync: 0 2024-01-24T15:34:44.977 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.wal_bytes_per_sync: 0 2024-01-24T15:34:44.977 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.strict_bytes_per_sync: 0 2024-01-24T15:34:44.977 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.compaction_readahead_size: 0 2024-01-24T15:34:44.977 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_background_flushes: -1 2024-01-24T15:34:44.977 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Compression algorithms supported: 2024-01-24T15:34:44.977 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-01-24T15:34:44.977 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: kZSTD supported: 0 2024-01-24T15:34:44.977 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: kXpressCompression supported: 0 2024-01-24T15:34:44.977 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: kLZ4HCCompression supported: 1 2024-01-24T15:34:44.977 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: kZlibCompression supported: 1 2024-01-24T15:34:44.977 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: kSnappyCompression supported: 1 2024-01-24T15:34:44.977 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: kLZ4Compression supported: 1 2024-01-24T15:34:44.977 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: kBZip2Compression supported: 0 2024-01-24T15:34:44.978 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Fast CRC32 supported: Supported on x86 2024-01-24T15:34:44.978 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: DMutex implementation: pthread_mutex_t 2024-01-24T15:34:44.978 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-01-24T15:34:44.978 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-01-24T15:34:44.978 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-01-24T15:34:44.978 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.merge_operator: 2024-01-24T15:34:44.978 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.compaction_filter: None 2024-01-24T15:34:44.978 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.compaction_filter_factory: None 2024-01-24T15:34:44.978 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.sst_partitioner_factory: None 2024-01-24T15:34:44.978 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.memtable_factory: SkipListFactory 2024-01-24T15:34:44.978 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.table_factory: BlockBasedTable 2024-01-24T15:34:44.978 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5616ded8d560) 2024-01-24T15:34:44.978 INFO:journalctl@ceph.mon.c.smithi204.stdout: cache_index_and_filter_blocks: 1 2024-01-24T15:34:44.978 INFO:journalctl@ceph.mon.c.smithi204.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-01-24T15:34:44.978 INFO:journalctl@ceph.mon.c.smithi204.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-01-24T15:34:44.978 INFO:journalctl@ceph.mon.c.smithi204.stdout: pin_top_level_index_and_filter: 1 2024-01-24T15:34:44.979 INFO:journalctl@ceph.mon.c.smithi204.stdout: index_type: 0 2024-01-24T15:34:44.979 INFO:journalctl@ceph.mon.c.smithi204.stdout: data_block_index_type: 0 2024-01-24T15:34:44.979 INFO:journalctl@ceph.mon.c.smithi204.stdout: index_shortening: 1 2024-01-24T15:34:44.979 INFO:journalctl@ceph.mon.c.smithi204.stdout: data_block_hash_table_util_ratio: 0.750000 2024-01-24T15:34:44.979 INFO:journalctl@ceph.mon.c.smithi204.stdout: checksum: 4 2024-01-24T15:34:44.979 INFO:journalctl@ceph.mon.c.smithi204.stdout: no_block_cache: 0 2024-01-24T15:34:44.979 INFO:journalctl@ceph.mon.c.smithi204.stdout: block_cache: 0x5616de09f1f0 2024-01-24T15:34:44.979 INFO:journalctl@ceph.mon.c.smithi204.stdout: block_cache_name: BinnedLRUCache 2024-01-24T15:34:44.979 INFO:journalctl@ceph.mon.c.smithi204.stdout: block_cache_options: 2024-01-24T15:34:44.979 INFO:journalctl@ceph.mon.c.smithi204.stdout: capacity : 536870912 2024-01-24T15:34:44.979 INFO:journalctl@ceph.mon.c.smithi204.stdout: num_shard_bits : 4 2024-01-24T15:34:44.979 INFO:journalctl@ceph.mon.c.smithi204.stdout: strict_capacity_limit : 0 2024-01-24T15:34:44.979 INFO:journalctl@ceph.mon.c.smithi204.stdout: high_pri_pool_ratio: 0.000 2024-01-24T15:34:44.979 INFO:journalctl@ceph.mon.c.smithi204.stdout: block_cache_compressed: (nil) 2024-01-24T15:34:44.979 INFO:journalctl@ceph.mon.c.smithi204.stdout: persistent_cache: (nil) 2024-01-24T15:34:44.979 INFO:journalctl@ceph.mon.c.smithi204.stdout: block_size: 4096 2024-01-24T15:34:44.980 INFO:journalctl@ceph.mon.c.smithi204.stdout: block_size_deviation: 10 2024-01-24T15:34:44.980 INFO:journalctl@ceph.mon.c.smithi204.stdout: block_restart_interval: 16 2024-01-24T15:34:44.980 INFO:journalctl@ceph.mon.c.smithi204.stdout: index_block_restart_interval: 1 2024-01-24T15:34:44.980 INFO:journalctl@ceph.mon.c.smithi204.stdout: metadata_block_size: 4096 2024-01-24T15:34:44.980 INFO:journalctl@ceph.mon.c.smithi204.stdout: partition_filters: 0 2024-01-24T15:34:44.980 INFO:journalctl@ceph.mon.c.smithi204.stdout: use_delta_encoding: 1 2024-01-24T15:34:44.980 INFO:journalctl@ceph.mon.c.smithi204.stdout: filter_policy: bloomfilter 2024-01-24T15:34:44.980 INFO:journalctl@ceph.mon.c.smithi204.stdout: whole_key_filtering: 1 2024-01-24T15:34:44.980 INFO:journalctl@ceph.mon.c.smithi204.stdout: verify_compression: 0 2024-01-24T15:34:44.980 INFO:journalctl@ceph.mon.c.smithi204.stdout: read_amp_bytes_per_bit: 0 2024-01-24T15:34:44.980 INFO:journalctl@ceph.mon.c.smithi204.stdout: format_version: 5 2024-01-24T15:34:44.980 INFO:journalctl@ceph.mon.c.smithi204.stdout: enable_index_compression: 1 2024-01-24T15:34:44.980 INFO:journalctl@ceph.mon.c.smithi204.stdout: block_align: 0 2024-01-24T15:34:44.980 INFO:journalctl@ceph.mon.c.smithi204.stdout: max_auto_readahead_size: 262144 2024-01-24T15:34:44.980 INFO:journalctl@ceph.mon.c.smithi204.stdout: prepopulate_block_cache: 0 2024-01-24T15:34:44.981 INFO:journalctl@ceph.mon.c.smithi204.stdout: initial_auto_readahead_size: 8192 2024-01-24T15:34:44.981 INFO:journalctl@ceph.mon.c.smithi204.stdout: num_file_reads_for_auto_readahead: 2 2024-01-24T15:34:44.981 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.write_buffer_size: 33554432 2024-01-24T15:34:44.981 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_write_buffer_number: 2 2024-01-24T15:34:44.981 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.compression: NoCompression 2024-01-24T15:34:44.981 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.bottommost_compression: Disabled 2024-01-24T15:34:44.981 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.prefix_extractor: nullptr 2024-01-24T15:34:44.981 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-01-24T15:34:44.981 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.num_levels: 7 2024-01-24T15:34:44.981 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-01-24T15:34:44.981 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-01-24T15:34:44.981 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-01-24T15:34:44.981 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-01-24T15:34:44.981 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-01-24T15:34:44.982 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-01-24T15:34:44.982 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-01-24T15:34:44.982 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-01-24T15:34:44.982 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-01-24T15:34:44.982 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-01-24T15:34:44.982 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-01-24T15:34:44.982 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-01-24T15:34:44.982 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.compression_opts.window_bits: -14 2024-01-24T15:34:44.982 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.compression_opts.level: 32767 2024-01-24T15:34:44.982 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.compression_opts.strategy: 0 2024-01-24T15:34:44.982 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-01-24T15:34:44.982 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-01-24T15:34:44.982 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-01-24T15:34:44.982 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-01-24T15:34:44.982 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.compression_opts.enabled: false 2024-01-24T15:34:44.982 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-01-24T15:34:44.983 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-01-24T15:34:44.983 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-01-24T15:34:44.983 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-01-24T15:34:44.983 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.target_file_size_base: 67108864 2024-01-24T15:34:44.983 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.target_file_size_multiplier: 1 2024-01-24T15:34:44.983 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-01-24T15:34:44.983 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-01-24T15:34:44.983 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-01-24T15:34:44.983 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-01-24T15:34:44.983 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-01-24T15:34:44.983 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-01-24T15:34:44.983 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-01-24T15:34:44.983 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-01-24T15:34:44.983 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-01-24T15:34:44.984 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-01-24T15:34:44.984 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-01-24T15:34:44.984 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-01-24T15:34:44.984 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-01-24T15:34:44.984 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.arena_block_size: 1048576 2024-01-24T15:34:44.984 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-01-24T15:34:44.984 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-01-24T15:34:44.984 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.disable_auto_compactions: 0 2024-01-24T15:34:44.984 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-01-24T15:34:44.984 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-01-24T15:34:44.984 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-01-24T15:34:44.984 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-01-24T15:34:44.984 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-01-24T15:34:44.985 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-01-24T15:34:44.985 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-01-24T15:34:44.985 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-01-24T15:34:44.985 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-01-24T15:34:44.985 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-01-24T15:34:44.985 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.table_properties_collectors: 2024-01-24T15:34:44.985 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.inplace_update_support: 0 2024-01-24T15:34:44.985 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.inplace_update_num_locks: 10000 2024-01-24T15:34:44.985 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-01-24T15:34:44.985 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-01-24T15:34:44.985 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.memtable_huge_page_size: 0 2024-01-24T15:34:44.985 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.bloom_locality: 0 2024-01-24T15:34:44.985 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.max_successive_merges: 0 2024-01-24T15:34:44.985 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.optimize_filters_for_hits: 0 2024-01-24T15:34:44.985 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.paranoid_file_checks: 0 2024-01-24T15:34:44.986 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.force_consistency_checks: 1 2024-01-24T15:34:44.986 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.report_bg_io_stats: 0 2024-01-24T15:34:44.986 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.ttl: 2592000 2024-01-24T15:34:44.986 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.periodic_compaction_seconds: 0 2024-01-24T15:34:44.986 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-01-24T15:34:44.986 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-01-24T15:34:44.986 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.enable_blob_files: false 2024-01-24T15:34:44.986 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.min_blob_size: 0 2024-01-24T15:34:44.986 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.blob_file_size: 268435456 2024-01-24T15:34:44.986 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.blob_compression_type: NoCompression 2024-01-24T15:34:44.986 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.enable_blob_garbage_collection: false 2024-01-24T15:34:44.986 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-01-24T15:34:44.986 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-01-24T15:34:44.986 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-01-24T15:34:44.986 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.blob_file_starting_level: 0 2024-01-24T15:34:44.987 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-01-24T15:34:44.987 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-01-24T15:34:44.987 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-01-24T15:34:44.987 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 173e650d-ce82-4513-bddd-240e5658ee41 2024-01-24T15:34:44.987 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: EVENT_LOG_v1 {"time_micros": 1706110484630701, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-01-24T15:34:44.987 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-01-24T15:34:44.987 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: EVENT_LOG_v1 {"time_micros": 1706110484631934, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1706110484, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "173e650d-ce82-4513-bddd-240e5658ee41", "db_session_id": "THQ3E6CXHF13LT8X392I", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-01-24T15:34:44.987 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: EVENT_LOG_v1 {"time_micros": 1706110484632135, "job": 1, "event": "recovery_finished"} 2024-01-24T15:34:44.987 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-01-24T15:34:44.987 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-01-24T15:34:44.987 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5616de13c000 2024-01-24T15:34:44.987 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: DB pointer 0x5616de12a000 2024-01-24T15:34:44.987 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-01-24T15:34:44.987 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-01-24T15:34:44.988 INFO:journalctl@ceph.mon.c.smithi204.stdout: ** DB Stats ** 2024-01-24T15:34:44.988 INFO:journalctl@ceph.mon.c.smithi204.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-24T15:34:44.988 INFO:journalctl@ceph.mon.c.smithi204.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-01-24T15:34:44.988 INFO:journalctl@ceph.mon.c.smithi204.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-24T15:34:44.988 INFO:journalctl@ceph.mon.c.smithi204.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-24T15:34:44.988 INFO:journalctl@ceph.mon.c.smithi204.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-01-24T15:34:44.988 INFO:journalctl@ceph.mon.c.smithi204.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-24T15:34:44.988 INFO:journalctl@ceph.mon.c.smithi204.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-24T15:34:44.988 INFO:journalctl@ceph.mon.c.smithi204.stdout: 2024-01-24T15:34:44.988 INFO:journalctl@ceph.mon.c.smithi204.stdout: ** Compaction Stats [default] ** 2024-01-24T15:34:44.988 INFO:journalctl@ceph.mon.c.smithi204.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-01-24T15:34:44.988 INFO:journalctl@ceph.mon.c.smithi204.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-01-24T15:34:44.988 INFO:journalctl@ceph.mon.c.smithi204.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-01-24T15:34:44.988 INFO:journalctl@ceph.mon.c.smithi204.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-01-24T15:34:44.988 INFO:journalctl@ceph.mon.c.smithi204.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-01-24T15:34:44.989 INFO:journalctl@ceph.mon.c.smithi204.stdout: 2024-01-24T15:34:44.989 INFO:journalctl@ceph.mon.c.smithi204.stdout: ** Compaction Stats [default] ** 2024-01-24T15:34:44.989 INFO:journalctl@ceph.mon.c.smithi204.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-01-24T15:34:44.989 INFO:journalctl@ceph.mon.c.smithi204.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-24T15:34:44.989 INFO:journalctl@ceph.mon.c.smithi204.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-01-24T15:34:44.989 INFO:journalctl@ceph.mon.c.smithi204.stdout: 2024-01-24T15:34:44.989 INFO:journalctl@ceph.mon.c.smithi204.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-01-24T15:34:44.989 INFO:journalctl@ceph.mon.c.smithi204.stdout: 2024-01-24T15:34:44.989 INFO:journalctl@ceph.mon.c.smithi204.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-24T15:34:44.989 INFO:journalctl@ceph.mon.c.smithi204.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-01-24T15:34:44.989 INFO:journalctl@ceph.mon.c.smithi204.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-24T15:34:44.989 INFO:journalctl@ceph.mon.c.smithi204.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-01-24T15:34:44.989 INFO:journalctl@ceph.mon.c.smithi204.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-01-24T15:34:44.989 INFO:journalctl@ceph.mon.c.smithi204.stdout: AddFile(Keys): cumulative 0, interval 0 2024-01-24T15:34:44.989 INFO:journalctl@ceph.mon.c.smithi204.stdout: Cumulative compaction: 0.00 GB write, 0.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-24T15:34:44.990 INFO:journalctl@ceph.mon.c.smithi204.stdout: Interval compaction: 0.00 GB write, 0.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-24T15:34:44.990 INFO:journalctl@ceph.mon.c.smithi204.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-24T15:34:44.990 INFO:journalctl@ceph.mon.c.smithi204.stdout: Block cache BinnedLRUCache@0x5616de09f1f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-01-24T15:34:44.990 INFO:journalctl@ceph.mon.c.smithi204.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-01-24T15:34:44.990 INFO:journalctl@ceph.mon.c.smithi204.stdout: 2024-01-24T15:34:44.990 INFO:journalctl@ceph.mon.c.smithi204.stdout: ** File Read Latency Histogram By Level [default] ** 2024-01-24T15:34:44.990 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-01-24T15:34:44.990 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: using public_addr v2:172.21.15.204:0/0 -> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-01-24T15:34:44.990 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 systemd[1]: Started Ceph mon.c for bede0bb6-bacd-11ee-95b1-87774f69a715. 2024-01-24T15:34:44.990 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: starting mon.c rank -1 at public addrs [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] at bind addrs [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:34:44.990 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: mon.c@-1(???) e0 preinit fsid bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:34:44.990 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: mon.c@-1(synchronizing).mds e1 new map 2024-01-24T15:34:44.990 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: mon.c@-1(synchronizing).mds e1 print_map 2024-01-24T15:34:44.990 INFO:journalctl@ceph.mon.c.smithi204.stdout: e1 2024-01-24T15:34:44.990 INFO:journalctl@ceph.mon.c.smithi204.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-01-24T15:34:44.991 INFO:journalctl@ceph.mon.c.smithi204.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-01-24T15:34:44.991 INFO:journalctl@ceph.mon.c.smithi204.stdout: legacy client fscid: -1 2024-01-24T15:34:44.991 INFO:journalctl@ceph.mon.c.smithi204.stdout: 2024-01-24T15:34:44.991 INFO:journalctl@ceph.mon.c.smithi204.stdout: No filesystems configured 2024-01-24T15:34:44.991 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-01-24T15:34:44.991 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-01-24T15:34:44.991 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-01-24T15:34:44.991 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-01-24T15:34:44.991 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-01-24T15:34:44.991 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-01-24T15:34:44.991 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-01-24T15:34:44.991 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-01-24T15:34:44.991 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-01-24T15:34:44.991 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-01-24T15:34:44.991 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:44.992 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-24T15:34:44.992 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:44.992 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:44.992 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/1399809391' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-01-24T15:34:44.992 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/1399809391' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-01-24T15:34:44.992 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: osdmap e4: 0 total, 0 up, 0 in 2024-01-24T15:34:44.992 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:44.992 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:44.992 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:44.992 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:44.992 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:44.992 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi204", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:34:44.992 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:34:44.993 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:34:44.993 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: Updating smithi204:/etc/ceph/ceph.conf 2024-01-24T15:34:44.993 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: Updating smithi204:/var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/config/ceph.conf 2024-01-24T15:34:44.993 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: Updating smithi204:/etc/ceph/ceph.client.admin.keyring 2024-01-24T15:34:44.993 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:44.993 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: Updating smithi204:/var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/config/ceph.client.admin.keyring 2024-01-24T15:34:44.993 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi005:172.21.15.5=a;smithi160:172.21.15.160=b;smithi204:172.21.15.204=c", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:34:44.993 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: Saving service mon spec with placement smithi005:172.21.15.5=a;smithi160:172.21.15.160=b;smithi204:172.21.15.204=c;count:3 2024-01-24T15:34:44.993 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:44.993 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:44.993 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:44.993 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:44.993 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-24T15:34:44.993 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:34:44.993 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: Deploying daemon mon.c on smithi204 2024-01-24T15:34:44.993 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:44.994 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: from='client.? 172.21.15.204:0/3119591455' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-24T15:34:44.994 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:44.994 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-01-24T15:34:44.994 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2024-01-24T15:34:44.994 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: expand_channel_meta expand map: {default=false} 2024-01-24T15:34:44.994 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: expand_channel_meta from 'false' to 'false' 2024-01-24T15:34:44.994 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: expand_channel_meta expanded map: {default=false} 2024-01-24T15:34:44.994 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: expand_channel_meta expand map: {default=info} 2024-01-24T15:34:44.994 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: expand_channel_meta from 'info' to 'info' 2024-01-24T15:34:44.994 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: expand_channel_meta expanded map: {default=info} 2024-01-24T15:34:44.994 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: expand_channel_meta expand map: {default=daemon} 2024-01-24T15:34:44.994 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: expand_channel_meta from 'daemon' to 'daemon' 2024-01-24T15:34:44.994 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: expand_channel_meta expanded map: {default=daemon} 2024-01-24T15:34:44.994 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: expand_channel_meta expand map: {default=debug} 2024-01-24T15:34:44.994 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: expand_channel_meta from 'debug' to 'debug' 2024-01-24T15:34:44.995 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:44 smithi204 ceph-mon[39634]: expand_channel_meta expanded map: {default=debug} 2024-01-24T15:34:49.773 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.771+0000 7f2b8ae00700 1 -- 172.21.15.204:0/1867780461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b640035c0 msgr2=0x7f2b64005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:49.773 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.771+0000 7f2b8ae00700 1 --2- 172.21.15.204:0/1867780461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b640035c0 0x7f2b64005a50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2b84100810 tx=0x7f2b74014ec0 comp rx=0 tx=0).stop 2024-01-24T15:34:49.773 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.771+0000 7f2b8ae00700 1 -- 172.21.15.204:0/1867780461 shutdown_connections 2024-01-24T15:34:49.773 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.771+0000 7f2b8ae00700 1 --2- 172.21.15.204:0/1867780461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b640035c0 0x7f2b64005a50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:49.773 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.771+0000 7f2b8ae00700 1 -- 172.21.15.204:0/1867780461 >> 172.21.15.204:0/1867780461 conn(0x7f2b840fc3b0 msgr2=0x7f2b840fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:49.773 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.771+0000 7f2b8ae00700 1 -- 172.21.15.204:0/1867780461 shutdown_connections 2024-01-24T15:34:49.773 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.771+0000 7f2b8ae00700 1 -- 172.21.15.204:0/1867780461 wait complete. 2024-01-24T15:34:49.774 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.772+0000 7f2b8ae00700 1 Processor -- start 2024-01-24T15:34:49.774 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.772+0000 7f2b8ae00700 1 -- start start 2024-01-24T15:34:49.774 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.773+0000 7f2b8ae00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b640035c0 0x7f2b84197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:49.775 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.773+0000 7f2b8ae00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b84198460 0x7f2b8419c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:49.775 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.773+0000 7f2b8ae00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b841989f0 con 0x7f2b640035c0 2024-01-24T15:34:49.775 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.773+0000 7f2b8ae00700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b84198b60 con 0x7f2b84198460 2024-01-24T15:34:49.776 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.773+0000 7f2b83e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b640035c0 0x7f2b84197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:49.776 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.773+0000 7f2b83e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b640035c0 0x7f2b84197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.204:52954/0 (socket says 172.21.15.204:52954) 2024-01-24T15:34:49.776 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.773+0000 7f2b83e00700 1 -- 172.21.15.204:0/2578319356 learned_addr learned my addr 172.21.15.204:0/2578319356 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-01-24T15:34:49.776 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.774+0000 7f2b83e00700 1 -- 172.21.15.204:0/2578319356 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b84198460 msgr2=0x7f2b8419c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:49.776 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.774+0000 7f2b83e00700 1 --2- 172.21.15.204:0/2578319356 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b84198460 0x7f2b8419c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:49.776 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.774+0000 7f2b83e00700 1 -- 172.21.15.204:0/2578319356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b74014910 con 0x7f2b640035c0 2024-01-24T15:34:49.776 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.774+0000 7f2b83e00700 1 --2- 172.21.15.204:0/2578319356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b640035c0 0x7f2b84197f20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2b74014460 tx=0x7f2b740140d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:49.777 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.775+0000 7f2b80c00700 1 -- 172.21.15.204:0/2578319356 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f2b74023070 con 0x7f2b640035c0 2024-01-24T15:34:49.777 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.775+0000 7f2b80c00700 1 -- 172.21.15.204:0/2578319356 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b7401e470 con 0x7f2b640035c0 2024-01-24T15:34:49.777 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.775+0000 7f2b8ae00700 1 -- 172.21.15.204:0/2578319356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8419ce70 con 0x7f2b640035c0 2024-01-24T15:34:49.777 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.775+0000 7f2b80c00700 1 -- 172.21.15.204:0/2578319356 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f2b74019040 con 0x7f2b640035c0 2024-01-24T15:34:49.777 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.775+0000 7f2b8ae00700 1 -- 172.21.15.204:0/2578319356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8419d3c0 con 0x7f2b640035c0 2024-01-24T15:34:49.778 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.776+0000 7f2b80c00700 1 -- 172.21.15.204:0/2578319356 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45323+0+0 (secure 0 0 0) 0x7f2b7401e5e0 con 0x7f2b640035c0 2024-01-24T15:34:49.778 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.776+0000 7f2b8ae00700 1 -- 172.21.15.204:0/2578319356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b84062370 con 0x7f2b640035c0 2024-01-24T15:34:49.778 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.777+0000 7f2b80c00700 1 --2- 172.21.15.204:0/2578319356 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f2b5c0381e0 0x7f2b5c03a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:49.778 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.777+0000 7f2b80c00700 1 -- 172.21.15.204:0/2578319356 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2b7404d280 con 0x7f2b640035c0 2024-01-24T15:34:49.779 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.777+0000 7f2b83400700 1 --2- 172.21.15.204:0/2578319356 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f2b5c0381e0 0x7f2b5c03a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:49.779 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.778+0000 7f2b83400700 1 --2- 172.21.15.204:0/2578319356 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f2b5c0381e0 0x7f2b5c03a6a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0098e0 tx=0x7f2b6c006dd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:49.784 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:49.782+0000 7f2b80c00700 1 -- 172.21.15.204:0/2578319356 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f2b74030b90 con 0x7f2b640035c0 2024-01-24T15:34:50.065 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:50.063+0000 7f2b8ae00700 1 -- 172.21.15.204:0/2578319356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2b841a2b70 con 0x7f2b640035c0 2024-01-24T15:34:50.065 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:50.064+0000 7f2b80c00700 1 -- 172.21.15.204:0/2578319356 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1002 (secure 0 0 0) 0x7f2b74030b90 con 0x7f2b640035c0 2024-01-24T15:34:50.066 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-01-24T15:34:50.066 INFO:teuthology.orchestra.run.smithi204.stdout:{"epoch":2,"fsid":"bede0bb6-bacd-11ee-95b1-87774f69a715","modified":"2024-01-24T15:34:44.672928Z","created":"2024-01-24T15:33:10.895521Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:3300","nonce":0},{"type":"v1","addr":"172.21.15.204:6789","nonce":0}]},"addr":"172.21.15.204:6789/0","public_addr":"172.21.15.204:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-01-24T15:34:50.068 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:50.066+0000 7f2b8ae00700 1 -- 172.21.15.204:0/2578319356 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f2b5c0381e0 msgr2=0x7f2b5c03a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:50.069 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:50.067+0000 7f2b8ae00700 1 --2- 172.21.15.204:0/2578319356 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f2b5c0381e0 0x7f2b5c03a6a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0098e0 tx=0x7f2b6c006dd0 comp rx=0 tx=0).stop 2024-01-24T15:34:50.069 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:50.067+0000 7f2b8ae00700 1 -- 172.21.15.204:0/2578319356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b640035c0 msgr2=0x7f2b84197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:50.069 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:50.067+0000 7f2b8ae00700 1 --2- 172.21.15.204:0/2578319356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b640035c0 0x7f2b84197f20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2b74014460 tx=0x7f2b740140d0 comp rx=0 tx=0).stop 2024-01-24T15:34:50.069 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:50.067+0000 7f2b8ae00700 1 -- 172.21.15.204:0/2578319356 shutdown_connections 2024-01-24T15:34:50.069 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:50.067+0000 7f2b8ae00700 1 --2- 172.21.15.204:0/2578319356 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f2b5c0381e0 0x7f2b5c03a6a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:50.069 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:50.067+0000 7f2b8ae00700 1 --2- 172.21.15.204:0/2578319356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2b640035c0 0x7f2b84197f20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:50.069 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:50.067+0000 7f2b8ae00700 1 --2- 172.21.15.204:0/2578319356 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f2b84198460 0x7f2b8419c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:50.069 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:50.067+0000 7f2b8ae00700 1 -- 172.21.15.204:0/2578319356 >> 172.21.15.204:0/2578319356 conn(0x7f2b840fc3b0 msgr2=0x7f2b841023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:50.069 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:50.067+0000 7f2b8ae00700 1 -- 172.21.15.204:0/2578319356 shutdown_connections 2024-01-24T15:34:50.069 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:50.067+0000 7f2b8ae00700 1 -- 172.21.15.204:0/2578319356 wait complete. 2024-01-24T15:34:50.070 INFO:teuthology.orchestra.run.smithi204.stderr:dumped monmap epoch 2 2024-01-24T15:34:50.090 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:49 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-24T15:34:50.090 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:49 smithi204 ceph-mon[39634]: mon.a calling monitor election 2024-01-24T15:34:50.090 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:49 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:34:50.090 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:49 smithi204 ceph-mon[39634]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:50.090 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:49 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:34:50.090 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:49 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:34:50.090 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:49 smithi204 ceph-mon[39634]: mon.c calling monitor election 2024-01-24T15:34:50.090 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:49 smithi204 ceph-mon[39634]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:50.091 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:49 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:34:50.091 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:49 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:34:50.091 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:49 smithi204 ceph-mon[39634]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:50.091 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:49 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:34:50.091 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:49 smithi204 ceph-mon[39634]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-01-24T15:34:50.091 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:49 smithi204 ceph-mon[39634]: monmap e2: 2 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],c=[v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-24T15:34:50.091 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:49 smithi204 ceph-mon[39634]: fsmap 2024-01-24T15:34:50.091 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:49 smithi204 ceph-mon[39634]: osdmap e4: 0 total, 0 up, 0 in 2024-01-24T15:34:50.091 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:49 smithi204 ceph-mon[39634]: mgrmap e13: x(active, since 42s) 2024-01-24T15:34:50.091 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:49 smithi204 ceph-mon[39634]: overall HEALTH_OK 2024-01-24T15:34:50.091 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:49 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:50.091 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:49 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:50.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:49 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-24T15:34:50.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:49 smithi005 ceph-mon[35346]: mon.a calling monitor election 2024-01-24T15:34:50.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:49 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:34:50.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:49 smithi005 ceph-mon[35346]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:50.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:49 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:34:50.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:49 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:34:50.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:49 smithi005 ceph-mon[35346]: mon.c calling monitor election 2024-01-24T15:34:50.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:49 smithi005 ceph-mon[35346]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:50.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:49 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:34:50.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:49 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:34:50.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:49 smithi005 ceph-mon[35346]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:50.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:49 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:34:50.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:49 smithi005 ceph-mon[35346]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-01-24T15:34:50.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:49 smithi005 ceph-mon[35346]: monmap e2: 2 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],c=[v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-24T15:34:50.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:49 smithi005 ceph-mon[35346]: fsmap 2024-01-24T15:34:50.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:49 smithi005 ceph-mon[35346]: osdmap e4: 0 total, 0 up, 0 in 2024-01-24T15:34:50.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:49 smithi005 ceph-mon[35346]: mgrmap e13: x(active, since 42s) 2024-01-24T15:34:50.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:49 smithi005 ceph-mon[35346]: overall HEALTH_OK 2024-01-24T15:34:50.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:49 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:50.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:49 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:51.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:50 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:51.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:50 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-24T15:34:51.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:50 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:34:51.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:50 smithi005 ceph-mon[35346]: Deploying daemon mon.b on smithi160 2024-01-24T15:34:51.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:50 smithi005 ceph-mon[35346]: from='client.? 172.21.15.204:0/2578319356' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-24T15:34:51.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:50 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:34:51.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:50 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:51.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:50 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-24T15:34:51.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:50 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:34:51.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:50 smithi204 ceph-mon[39634]: Deploying daemon mon.b on smithi160 2024-01-24T15:34:51.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:50 smithi204 ceph-mon[39634]: from='client.? 172.21.15.204:0/2578319356' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-24T15:34:51.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:50 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:34:51.525 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-01-24T15:34:51.525 DEBUG:teuthology.orchestra.run.smithi204:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph mon dump -f json 2024-01-24T15:34:51.879 INFO:teuthology.orchestra.run.smithi204.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.c/config 2024-01-24T15:34:51.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:51 smithi005 ceph-mon[35346]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:51.933 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:34:51 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:34:51.672+0000 7f3a95c00700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-24T15:34:51.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:51 smithi204 ceph-mon[39634]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:52.802 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:52 smithi160 systemd[1]: Starting Ceph mon.b for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:34:53.154 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.152+0000 7efeb5200700 1 -- 172.21.15.204:0/1913489508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb01068e0 msgr2=0x7efeb0106cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:53.155 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.152+0000 7efeb5200700 1 --2- 172.21.15.204:0/1913489508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb01068e0 0x7efeb0106cc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efea0009910 tx=0x7efea0009c20 comp rx=0 tx=0).stop 2024-01-24T15:34:53.155 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.152+0000 7efeb5200700 1 -- 172.21.15.204:0/1913489508 shutdown_connections 2024-01-24T15:34:53.155 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.152+0000 7efeb5200700 1 --2- 172.21.15.204:0/1913489508 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb01068e0 0x7efeb0106cc0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:53.155 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.152+0000 7efeb5200700 1 -- 172.21.15.204:0/1913489508 >> 172.21.15.204:0/1913489508 conn(0x7efeb00fc3b0 msgr2=0x7efeb00fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:53.155 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.152+0000 7efeb5200700 1 -- 172.21.15.204:0/1913489508 shutdown_connections 2024-01-24T15:34:53.155 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.152+0000 7efeb5200700 1 -- 172.21.15.204:0/1913489508 wait complete. 2024-01-24T15:34:53.155 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.153+0000 7efeb5200700 1 Processor -- start 2024-01-24T15:34:53.156 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.153+0000 7efeb5200700 1 -- start start 2024-01-24T15:34:53.157 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.154+0000 7efeb5200700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efeb01068e0 0x7efeb0197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:53.157 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.154+0000 7efeb5200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb0198520 0x7efeb019c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:53.157 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.154+0000 7efeb5200700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb0198ab0 con 0x7efeb0198520 2024-01-24T15:34:53.157 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.154+0000 7efeb5200700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb0198c20 con 0x7efeb01068e0 2024-01-24T15:34:53.157 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.154+0000 7efeade00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efeb01068e0 0x7efeb0197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:53.157 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.154+0000 7efeade00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efeb01068e0 0x7efeb0197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:38158/0 (socket says 172.21.15.204:38158) 2024-01-24T15:34:53.157 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.154+0000 7efeade00700 1 -- 172.21.15.204:0/877693138 learned_addr learned my addr 172.21.15.204:0/877693138 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-01-24T15:34:53.157 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.154+0000 7efeade00700 1 -- 172.21.15.204:0/877693138 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efeb01068e0 msgr2=0x7efeb0197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-01-24T15:34:53.157 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.154+0000 7efeade00700 1 -- 172.21.15.204:0/877693138 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efeb01068e0 msgr2=0x7efeb0197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-01-24T15:34:53.157 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.154+0000 7efeade00700 1 --2- 172.21.15.204:0/877693138 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efeb01068e0 0x7efeb0197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-24T15:34:53.157 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.154+0000 7efeade00700 1 --2- 172.21.15.204:0/877693138 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efeb01068e0 0x7efeb0197fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-24T15:34:53.157 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.154+0000 7efead400700 1 --2- 172.21.15.204:0/877693138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb0198520 0x7efeb019c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:53.158 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.155+0000 7efead400700 1 -- 172.21.15.204:0/877693138 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efeb01068e0 msgr2=0x7efeb0197fe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-24T15:34:53.158 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.155+0000 7efead400700 1 --2- 172.21.15.204:0/877693138 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efeb01068e0 0x7efeb0197fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:53.158 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.155+0000 7efead400700 1 -- 172.21.15.204:0/877693138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea00095f0 con 0x7efeb0198520 2024-01-24T15:34:53.158 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.155+0000 7efead400700 1 --2- 172.21.15.204:0/877693138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb0198520 0x7efeb019c990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efe9800b4d0 tx=0x7efe9800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:53.159 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.155+0000 7efea6a00700 1 -- 172.21.15.204:0/877693138 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7efe98011630 con 0x7efeb0198520 2024-01-24T15:34:53.159 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.156+0000 7efea6a00700 1 -- 172.21.15.204:0/877693138 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efe98011c20 con 0x7efeb0198520 2024-01-24T15:34:53.159 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.156+0000 7efeb5200700 1 -- 172.21.15.204:0/877693138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb019cf30 con 0x7efeb0198520 2024-01-24T15:34:53.159 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.156+0000 7efea6a00700 1 -- 172.21.15.204:0/877693138 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7efe98010c60 con 0x7efeb0198520 2024-01-24T15:34:53.159 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.156+0000 7efeb5200700 1 -- 172.21.15.204:0/877693138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb019d480 con 0x7efeb0198520 2024-01-24T15:34:53.160 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.156+0000 7efeb5200700 1 -- 172.21.15.204:0/877693138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb0062370 con 0x7efeb0198520 2024-01-24T15:34:53.160 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.157+0000 7efea6a00700 1 -- 172.21.15.204:0/877693138 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45323+0+0 (secure 0 0 0) 0x7efe98011790 con 0x7efeb0198520 2024-01-24T15:34:53.160 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.157+0000 7efea6a00700 1 --2- 172.21.15.204:0/877693138 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7efe900381e0 0x7efe9003a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:34:53.160 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.157+0000 7efea6a00700 1 -- 172.21.15.204:0/877693138 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7efe9804a990 con 0x7efeb0198520 2024-01-24T15:34:53.160 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.158+0000 7efeade00700 1 --2- 172.21.15.204:0/877693138 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7efe900381e0 0x7efe9003a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:34:53.160 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.158+0000 7efeade00700 1 --2- 172.21.15.204:0/877693138 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7efe900381e0 0x7efe9003a6a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efea00092e0 tx=0x7efea000b580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:34:53.165 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.163+0000 7efea6a00700 1 -- 172.21.15.204:0/877693138 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7efe98010380 con 0x7efeb0198520 2024-01-24T15:34:53.185 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 bash[38945]: 4ede6ac45c9296bfeabcbfac3588d2e791f1a9ad02ce13a7e04fe2c524662b5b 2024-01-24T15:34:53.186 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 systemd[1]: Started Ceph mon.b for bede0bb6-bacd-11ee-95b1-87774f69a715. 2024-01-24T15:34:53.186 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: set uid:gid to 167:167 (ceph:ceph) 2024-01-24T15:34:53.245 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.243+0000 7efea6a00700 1 -- 172.21.15.204:0/877693138 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9804f020 con 0x7efeb0198520 2024-01-24T15:34:53.441 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:53.439+0000 7efeb5200700 1 -- 172.21.15.204:0/877693138 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7efeb019d760 con 0x7efeb0198520 2024-01-24T15:34:53.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: ceph version 18.2.1-341-g4e3182a6 (4e3182a65800aed6d4aa2f6b86da3cfd72188134) reef (stable), process ceph-mon, pid 7 2024-01-24T15:34:53.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: pidfile_write: ignore empty --pid-file 2024-01-24T15:34:53.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: load: jerasure load: lrc 2024-01-24T15:34:53.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: RocksDB version: 7.9.2 2024-01-24T15:34:53.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Git sha 0 2024-01-24T15:34:53.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Compile date 2024-01-24 06:39:28 2024-01-24T15:34:53.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: DB SUMMARY 2024-01-24T15:34:53.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: DB Session ID: PBVHPJVZA0JDS993KW1Z 2024-01-24T15:34:53.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: CURRENT file: CURRENT 2024-01-24T15:34:53.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: IDENTITY file: IDENTITY 2024-01-24T15:34:53.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-01-24T15:34:53.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-01-24T15:34:53.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-01-24T15:34:53.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.error_if_exists: 0 2024-01-24T15:34:53.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.create_if_missing: 0 2024-01-24T15:34:53.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.paranoid_checks: 1 2024-01-24T15:34:53.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.flush_verify_memtable_count: 1 2024-01-24T15:34:53.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-01-24T15:34:53.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-01-24T15:34:53.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.env: 0x5593c8280720 2024-01-24T15:34:53.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.fs: PosixFileSystem 2024-01-24T15:34:53.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.info_log: 0x5593ca3c7460 2024-01-24T15:34:53.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_file_opening_threads: 16 2024-01-24T15:34:53.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.statistics: (nil) 2024-01-24T15:34:53.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.use_fsync: 0 2024-01-24T15:34:53.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_log_file_size: 0 2024-01-24T15:34:53.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-01-24T15:34:53.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.log_file_time_to_roll: 0 2024-01-24T15:34:53.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.keep_log_file_num: 1000 2024-01-24T15:34:53.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.recycle_log_file_num: 0 2024-01-24T15:34:53.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.allow_fallocate: 1 2024-01-24T15:34:53.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.allow_mmap_reads: 0 2024-01-24T15:34:53.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.allow_mmap_writes: 0 2024-01-24T15:34:53.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.use_direct_reads: 0 2024-01-24T15:34:53.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-01-24T15:34:53.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.create_missing_column_families: 0 2024-01-24T15:34:53.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.db_log_dir: 2024-01-24T15:34:53.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.wal_dir: 2024-01-24T15:34:53.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.table_cache_numshardbits: 6 2024-01-24T15:34:53.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.WAL_ttl_seconds: 0 2024-01-24T15:34:53.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.WAL_size_limit_MB: 0 2024-01-24T15:34:53.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-01-24T15:34:53.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-01-24T15:34:53.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.is_fd_close_on_exec: 1 2024-01-24T15:34:53.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.advise_random_on_open: 1 2024-01-24T15:34:53.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.db_write_buffer_size: 0 2024-01-24T15:34:53.510 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.write_buffer_manager: 0x5593c9658320 2024-01-24T15:34:53.511 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-01-24T15:34:53.511 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-01-24T15:34:53.511 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.use_adaptive_mutex: 0 2024-01-24T15:34:53.511 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.rate_limiter: (nil) 2024-01-24T15:34:53.511 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-01-24T15:34:53.511 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.wal_recovery_mode: 2 2024-01-24T15:34:53.511 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.enable_thread_tracking: 0 2024-01-24T15:34:53.511 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.enable_pipelined_write: 0 2024-01-24T15:34:53.511 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.unordered_write: 0 2024-01-24T15:34:53.511 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-01-24T15:34:53.511 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-01-24T15:34:53.511 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-01-24T15:34:53.511 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-01-24T15:34:53.511 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.row_cache: None 2024-01-24T15:34:53.511 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.wal_filter: None 2024-01-24T15:34:53.511 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-01-24T15:34:53.512 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.allow_ingest_behind: 0 2024-01-24T15:34:53.512 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.two_write_queues: 0 2024-01-24T15:34:53.512 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.manual_wal_flush: 0 2024-01-24T15:34:53.512 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.wal_compression: 0 2024-01-24T15:34:53.512 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.atomic_flush: 0 2024-01-24T15:34:53.512 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-01-24T15:34:53.512 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.persist_stats_to_disk: 0 2024-01-24T15:34:53.512 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.write_dbid_to_manifest: 0 2024-01-24T15:34:53.512 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.log_readahead_size: 0 2024-01-24T15:34:53.512 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-01-24T15:34:53.512 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.best_efforts_recovery: 0 2024-01-24T15:34:53.512 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-01-24T15:34:53.512 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-01-24T15:34:53.512 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.allow_data_in_errors: 0 2024-01-24T15:34:53.513 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.db_host_id: __hostname__ 2024-01-24T15:34:53.513 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.enforce_single_del_contracts: true 2024-01-24T15:34:53.513 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_background_jobs: 2 2024-01-24T15:34:53.513 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_background_compactions: -1 2024-01-24T15:34:53.513 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_subcompactions: 1 2024-01-24T15:34:53.513 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-01-24T15:34:53.513 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-01-24T15:34:53.513 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.delayed_write_rate : 16777216 2024-01-24T15:34:53.513 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_total_wal_size: 0 2024-01-24T15:34:53.513 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-01-24T15:34:53.513 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.stats_dump_period_sec: 600 2024-01-24T15:34:53.513 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.stats_persist_period_sec: 600 2024-01-24T15:34:53.513 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-01-24T15:34:53.513 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_open_files: -1 2024-01-24T15:34:53.513 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.bytes_per_sync: 0 2024-01-24T15:34:53.514 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.wal_bytes_per_sync: 0 2024-01-24T15:34:53.514 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.strict_bytes_per_sync: 0 2024-01-24T15:34:53.514 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.compaction_readahead_size: 0 2024-01-24T15:34:53.514 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_background_flushes: -1 2024-01-24T15:34:53.514 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Compression algorithms supported: 2024-01-24T15:34:53.514 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-01-24T15:34:53.514 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: kZSTD supported: 0 2024-01-24T15:34:53.514 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: kXpressCompression supported: 0 2024-01-24T15:34:53.514 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: kLZ4HCCompression supported: 1 2024-01-24T15:34:53.514 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: kZlibCompression supported: 1 2024-01-24T15:34:53.514 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: kSnappyCompression supported: 1 2024-01-24T15:34:53.514 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: kLZ4Compression supported: 1 2024-01-24T15:34:53.514 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: kBZip2Compression supported: 0 2024-01-24T15:34:53.514 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Fast CRC32 supported: Supported on x86 2024-01-24T15:34:53.514 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: DMutex implementation: pthread_mutex_t 2024-01-24T15:34:53.515 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-01-24T15:34:53.515 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-01-24T15:34:53.515 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-01-24T15:34:53.515 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.merge_operator: 2024-01-24T15:34:53.515 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.compaction_filter: None 2024-01-24T15:34:53.515 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.compaction_filter_factory: None 2024-01-24T15:34:53.515 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.sst_partitioner_factory: None 2024-01-24T15:34:53.515 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.memtable_factory: SkipListFactory 2024-01-24T15:34:53.515 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.table_factory: BlockBasedTable 2024-01-24T15:34:53.515 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5593ca3c7560) 2024-01-24T15:34:53.515 INFO:journalctl@ceph.mon.b.smithi160.stdout: cache_index_and_filter_blocks: 1 2024-01-24T15:34:53.515 INFO:journalctl@ceph.mon.b.smithi160.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-01-24T15:34:53.515 INFO:journalctl@ceph.mon.b.smithi160.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-01-24T15:34:53.515 INFO:journalctl@ceph.mon.b.smithi160.stdout: pin_top_level_index_and_filter: 1 2024-01-24T15:34:53.515 INFO:journalctl@ceph.mon.b.smithi160.stdout: index_type: 0 2024-01-24T15:34:53.516 INFO:journalctl@ceph.mon.b.smithi160.stdout: data_block_index_type: 0 2024-01-24T15:34:53.516 INFO:journalctl@ceph.mon.b.smithi160.stdout: index_shortening: 1 2024-01-24T15:34:53.516 INFO:journalctl@ceph.mon.b.smithi160.stdout: data_block_hash_table_util_ratio: 0.750000 2024-01-24T15:34:53.516 INFO:journalctl@ceph.mon.b.smithi160.stdout: checksum: 4 2024-01-24T15:34:53.516 INFO:journalctl@ceph.mon.b.smithi160.stdout: no_block_cache: 0 2024-01-24T15:34:53.516 INFO:journalctl@ceph.mon.b.smithi160.stdout: block_cache: 0x5593c96d91f0 2024-01-24T15:34:53.516 INFO:journalctl@ceph.mon.b.smithi160.stdout: block_cache_name: BinnedLRUCache 2024-01-24T15:34:53.516 INFO:journalctl@ceph.mon.b.smithi160.stdout: block_cache_options: 2024-01-24T15:34:53.516 INFO:journalctl@ceph.mon.b.smithi160.stdout: capacity : 536870912 2024-01-24T15:34:53.516 INFO:journalctl@ceph.mon.b.smithi160.stdout: num_shard_bits : 4 2024-01-24T15:34:53.516 INFO:journalctl@ceph.mon.b.smithi160.stdout: strict_capacity_limit : 0 2024-01-24T15:34:53.516 INFO:journalctl@ceph.mon.b.smithi160.stdout: high_pri_pool_ratio: 0.000 2024-01-24T15:34:53.516 INFO:journalctl@ceph.mon.b.smithi160.stdout: block_cache_compressed: (nil) 2024-01-24T15:34:53.516 INFO:journalctl@ceph.mon.b.smithi160.stdout: persistent_cache: (nil) 2024-01-24T15:34:53.517 INFO:journalctl@ceph.mon.b.smithi160.stdout: block_size: 4096 2024-01-24T15:34:53.517 INFO:journalctl@ceph.mon.b.smithi160.stdout: block_size_deviation: 10 2024-01-24T15:34:53.517 INFO:journalctl@ceph.mon.b.smithi160.stdout: block_restart_interval: 16 2024-01-24T15:34:53.517 INFO:journalctl@ceph.mon.b.smithi160.stdout: index_block_restart_interval: 1 2024-01-24T15:34:53.517 INFO:journalctl@ceph.mon.b.smithi160.stdout: metadata_block_size: 4096 2024-01-24T15:34:53.517 INFO:journalctl@ceph.mon.b.smithi160.stdout: partition_filters: 0 2024-01-24T15:34:53.517 INFO:journalctl@ceph.mon.b.smithi160.stdout: use_delta_encoding: 1 2024-01-24T15:34:53.517 INFO:journalctl@ceph.mon.b.smithi160.stdout: filter_policy: bloomfilter 2024-01-24T15:34:53.517 INFO:journalctl@ceph.mon.b.smithi160.stdout: whole_key_filtering: 1 2024-01-24T15:34:53.517 INFO:journalctl@ceph.mon.b.smithi160.stdout: verify_compression: 0 2024-01-24T15:34:53.517 INFO:journalctl@ceph.mon.b.smithi160.stdout: read_amp_bytes_per_bit: 0 2024-01-24T15:34:53.517 INFO:journalctl@ceph.mon.b.smithi160.stdout: format_version: 5 2024-01-24T15:34:53.517 INFO:journalctl@ceph.mon.b.smithi160.stdout: enable_index_compression: 1 2024-01-24T15:34:53.517 INFO:journalctl@ceph.mon.b.smithi160.stdout: block_align: 0 2024-01-24T15:34:53.517 INFO:journalctl@ceph.mon.b.smithi160.stdout: max_auto_readahead_size: 262144 2024-01-24T15:34:53.518 INFO:journalctl@ceph.mon.b.smithi160.stdout: prepopulate_block_cache: 0 2024-01-24T15:34:53.518 INFO:journalctl@ceph.mon.b.smithi160.stdout: initial_auto_readahead_size: 8192 2024-01-24T15:34:53.518 INFO:journalctl@ceph.mon.b.smithi160.stdout: num_file_reads_for_auto_readahead: 2 2024-01-24T15:34:53.518 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.write_buffer_size: 33554432 2024-01-24T15:34:53.518 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_write_buffer_number: 2 2024-01-24T15:34:53.518 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.compression: NoCompression 2024-01-24T15:34:53.518 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.bottommost_compression: Disabled 2024-01-24T15:34:53.518 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.prefix_extractor: nullptr 2024-01-24T15:34:53.518 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-01-24T15:34:53.518 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.num_levels: 7 2024-01-24T15:34:53.518 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-01-24T15:34:53.518 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-01-24T15:34:53.518 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-01-24T15:34:53.518 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-01-24T15:34:53.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-01-24T15:34:53.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-01-24T15:34:53.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-01-24T15:34:53.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-01-24T15:34:53.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-01-24T15:34:53.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-01-24T15:34:53.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-01-24T15:34:53.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-01-24T15:34:53.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.compression_opts.window_bits: -14 2024-01-24T15:34:53.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.compression_opts.level: 32767 2024-01-24T15:34:53.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.compression_opts.strategy: 0 2024-01-24T15:34:53.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-01-24T15:34:53.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-01-24T15:34:53.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-01-24T15:34:53.519 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-01-24T15:34:53.520 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.compression_opts.enabled: false 2024-01-24T15:34:53.520 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-01-24T15:34:53.520 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-01-24T15:34:53.520 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-01-24T15:34:53.520 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-01-24T15:34:53.520 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.target_file_size_base: 67108864 2024-01-24T15:34:53.520 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.target_file_size_multiplier: 1 2024-01-24T15:34:53.520 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-01-24T15:34:53.520 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-01-24T15:34:53.520 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-01-24T15:34:53.520 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-01-24T15:34:53.520 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-01-24T15:34:53.520 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-01-24T15:34:53.520 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-01-24T15:34:53.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-01-24T15:34:53.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-01-24T15:34:53.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-01-24T15:34:53.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-01-24T15:34:53.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-01-24T15:34:53.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-01-24T15:34:53.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.arena_block_size: 1048576 2024-01-24T15:34:53.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-01-24T15:34:53.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-01-24T15:34:53.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.disable_auto_compactions: 0 2024-01-24T15:34:53.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-01-24T15:34:53.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-01-24T15:34:53.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-01-24T15:34:53.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-01-24T15:34:53.521 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-01-24T15:34:53.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-01-24T15:34:53.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-01-24T15:34:53.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-01-24T15:34:53.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-01-24T15:34:53.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-01-24T15:34:53.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.table_properties_collectors: 2024-01-24T15:34:53.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.inplace_update_support: 0 2024-01-24T15:34:53.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.inplace_update_num_locks: 10000 2024-01-24T15:34:53.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-01-24T15:34:53.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-01-24T15:34:53.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.memtable_huge_page_size: 0 2024-01-24T15:34:53.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.bloom_locality: 0 2024-01-24T15:34:53.522 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.max_successive_merges: 0 2024-01-24T15:34:53.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.optimize_filters_for_hits: 0 2024-01-24T15:34:53.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.paranoid_file_checks: 0 2024-01-24T15:34:53.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.force_consistency_checks: 1 2024-01-24T15:34:53.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.report_bg_io_stats: 0 2024-01-24T15:34:53.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.ttl: 2592000 2024-01-24T15:34:53.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.periodic_compaction_seconds: 0 2024-01-24T15:34:53.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-01-24T15:34:53.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-01-24T15:34:53.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.enable_blob_files: false 2024-01-24T15:34:53.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.min_blob_size: 0 2024-01-24T15:34:53.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.blob_file_size: 268435456 2024-01-24T15:34:53.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.blob_compression_type: NoCompression 2024-01-24T15:34:53.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.enable_blob_garbage_collection: false 2024-01-24T15:34:53.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-01-24T15:34:53.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-01-24T15:34:53.523 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-01-24T15:34:53.524 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.blob_file_starting_level: 0 2024-01-24T15:34:53.524 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-01-24T15:34:53.524 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-01-24T15:34:53.524 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-01-24T15:34:53.524 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d7d9d644-84b5-4801-bcd9-efeee7d5aabd 2024-01-24T15:34:53.525 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: EVENT_LOG_v1 {"time_micros": 1706110493195710, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-01-24T15:34:53.525 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-01-24T15:34:53.525 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: EVENT_LOG_v1 {"time_micros": 1706110493197153, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1706110493, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d7d9d644-84b5-4801-bcd9-efeee7d5aabd", "db_session_id": "PBVHPJVZA0JDS993KW1Z", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-01-24T15:34:53.525 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: EVENT_LOG_v1 {"time_micros": 1706110493197422, "job": 1, "event": "recovery_finished"} 2024-01-24T15:34:53.525 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-01-24T15:34:53.525 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-01-24T15:34:53.525 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5593c9776000 2024-01-24T15:34:53.525 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: DB pointer 0x5593c9764000 2024-01-24T15:34:53.525 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-01-24T15:34:53.525 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-01-24T15:34:53.525 INFO:journalctl@ceph.mon.b.smithi160.stdout: ** DB Stats ** 2024-01-24T15:34:53.525 INFO:journalctl@ceph.mon.b.smithi160.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-24T15:34:53.525 INFO:journalctl@ceph.mon.b.smithi160.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-01-24T15:34:53.526 INFO:journalctl@ceph.mon.b.smithi160.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-24T15:34:53.526 INFO:journalctl@ceph.mon.b.smithi160.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-24T15:34:53.526 INFO:journalctl@ceph.mon.b.smithi160.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-01-24T15:34:53.526 INFO:journalctl@ceph.mon.b.smithi160.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-24T15:34:53.526 INFO:journalctl@ceph.mon.b.smithi160.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-24T15:34:53.526 INFO:journalctl@ceph.mon.b.smithi160.stdout: 2024-01-24T15:34:53.526 INFO:journalctl@ceph.mon.b.smithi160.stdout: ** Compaction Stats [default] ** 2024-01-24T15:34:53.526 INFO:journalctl@ceph.mon.b.smithi160.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-01-24T15:34:53.526 INFO:journalctl@ceph.mon.b.smithi160.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-01-24T15:34:53.526 INFO:journalctl@ceph.mon.b.smithi160.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-01-24T15:34:53.526 INFO:journalctl@ceph.mon.b.smithi160.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-01-24T15:34:53.526 INFO:journalctl@ceph.mon.b.smithi160.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-01-24T15:34:53.526 INFO:journalctl@ceph.mon.b.smithi160.stdout: 2024-01-24T15:34:53.526 INFO:journalctl@ceph.mon.b.smithi160.stdout: ** Compaction Stats [default] ** 2024-01-24T15:34:53.526 INFO:journalctl@ceph.mon.b.smithi160.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-01-24T15:34:53.526 INFO:journalctl@ceph.mon.b.smithi160.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-24T15:34:53.527 INFO:journalctl@ceph.mon.b.smithi160.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-01-24T15:34:53.527 INFO:journalctl@ceph.mon.b.smithi160.stdout: 2024-01-24T15:34:53.527 INFO:journalctl@ceph.mon.b.smithi160.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-01-24T15:34:53.527 INFO:journalctl@ceph.mon.b.smithi160.stdout: 2024-01-24T15:34:53.527 INFO:journalctl@ceph.mon.b.smithi160.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-24T15:34:53.527 INFO:journalctl@ceph.mon.b.smithi160.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-01-24T15:34:53.527 INFO:journalctl@ceph.mon.b.smithi160.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-24T15:34:53.527 INFO:journalctl@ceph.mon.b.smithi160.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-01-24T15:34:53.527 INFO:journalctl@ceph.mon.b.smithi160.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-01-24T15:34:53.527 INFO:journalctl@ceph.mon.b.smithi160.stdout: AddFile(Keys): cumulative 0, interval 0 2024-01-24T15:34:53.527 INFO:journalctl@ceph.mon.b.smithi160.stdout: Cumulative compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-24T15:34:53.527 INFO:journalctl@ceph.mon.b.smithi160.stdout: Interval compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-24T15:34:53.527 INFO:journalctl@ceph.mon.b.smithi160.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-24T15:34:53.527 INFO:journalctl@ceph.mon.b.smithi160.stdout: Block cache BinnedLRUCache@0x5593c96d91f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-01-24T15:34:53.527 INFO:journalctl@ceph.mon.b.smithi160.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-01-24T15:34:53.527 INFO:journalctl@ceph.mon.b.smithi160.stdout: 2024-01-24T15:34:53.528 INFO:journalctl@ceph.mon.b.smithi160.stdout: ** File Read Latency Histogram By Level [default] ** 2024-01-24T15:34:53.528 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-01-24T15:34:53.528 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: using public_addr v2:172.21.15.160:0/0 -> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-01-24T15:34:53.528 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: starting mon.b rank -1 at public addrs [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] at bind addrs [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:34:53.528 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: mon.b@-1(???) e0 preinit fsid bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:34:53.528 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: mon.b@-1(synchronizing).mds e1 new map 2024-01-24T15:34:53.528 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: mon.b@-1(synchronizing).mds e1 print_map 2024-01-24T15:34:53.528 INFO:journalctl@ceph.mon.b.smithi160.stdout: e1 2024-01-24T15:34:53.528 INFO:journalctl@ceph.mon.b.smithi160.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-01-24T15:34:53.528 INFO:journalctl@ceph.mon.b.smithi160.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-01-24T15:34:53.528 INFO:journalctl@ceph.mon.b.smithi160.stdout: legacy client fscid: -1 2024-01-24T15:34:53.528 INFO:journalctl@ceph.mon.b.smithi160.stdout: 2024-01-24T15:34:53.528 INFO:journalctl@ceph.mon.b.smithi160.stdout: No filesystems configured 2024-01-24T15:34:53.528 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-01-24T15:34:53.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-01-24T15:34:53.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-01-24T15:34:53.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-01-24T15:34:53.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-01-24T15:34:53.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-01-24T15:34:53.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-01-24T15:34:53.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-01-24T15:34:53.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-01-24T15:34:53.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-01-24T15:34:53.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:53.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-24T15:34:53.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:53.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:53.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/1399809391' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-01-24T15:34:53.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/1399809391' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-01-24T15:34:53.529 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: osdmap e4: 0 total, 0 up, 0 in 2024-01-24T15:34:53.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:53.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:53.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:53.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:53.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:53.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi204", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:34:53.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:34:53.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:34:53.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: Updating smithi204:/etc/ceph/ceph.conf 2024-01-24T15:34:53.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: Updating smithi204:/var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/config/ceph.conf 2024-01-24T15:34:53.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: Updating smithi204:/etc/ceph/ceph.client.admin.keyring 2024-01-24T15:34:53.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:53.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: Updating smithi204:/var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/config/ceph.client.admin.keyring 2024-01-24T15:34:53.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi005:172.21.15.5=a;smithi160:172.21.15.160=b;smithi204:172.21.15.204=c", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:34:53.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: Saving service mon spec with placement smithi005:172.21.15.5=a;smithi160:172.21.15.160=b;smithi204:172.21.15.204=c;count:3 2024-01-24T15:34:53.530 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:53.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:53.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:53.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:53.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-24T15:34:53.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:34:53.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: Deploying daemon mon.c on smithi204 2024-01-24T15:34:53.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:53.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='client.? 172.21.15.204:0/3119591455' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-24T15:34:53.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:53.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-24T15:34:53.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: mon.a calling monitor election 2024-01-24T15:34:53.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:34:53.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:53.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:34:53.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:34:53.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: mon.c calling monitor election 2024-01-24T15:34:53.531 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:53.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:34:53.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:34:53.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:53.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:34:53.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-01-24T15:34:53.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: monmap e2: 2 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],c=[v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-24T15:34:53.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: fsmap 2024-01-24T15:34:53.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: osdmap e4: 0 total, 0 up, 0 in 2024-01-24T15:34:53.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: mgrmap e13: x(active, since 42s) 2024-01-24T15:34:53.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: overall HEALTH_OK 2024-01-24T15:34:53.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:53.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:53.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:53.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-24T15:34:53.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:34:53.532 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: Deploying daemon mon.b on smithi160 2024-01-24T15:34:53.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='client.? 172.21.15.204:0/2578319356' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-24T15:34:53.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:34:53.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:53.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-01-24T15:34:53.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2024-01-24T15:34:53.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: expand_channel_meta expand map: {default=false} 2024-01-24T15:34:53.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: expand_channel_meta from 'false' to 'false' 2024-01-24T15:34:53.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: expand_channel_meta expanded map: {default=false} 2024-01-24T15:34:53.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: expand_channel_meta expand map: {default=info} 2024-01-24T15:34:53.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: expand_channel_meta from 'info' to 'info' 2024-01-24T15:34:53.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: expand_channel_meta expanded map: {default=info} 2024-01-24T15:34:53.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: expand_channel_meta expand map: {default=daemon} 2024-01-24T15:34:53.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: expand_channel_meta from 'daemon' to 'daemon' 2024-01-24T15:34:53.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: expand_channel_meta expanded map: {default=daemon} 2024-01-24T15:34:53.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: expand_channel_meta expand map: {default=debug} 2024-01-24T15:34:53.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: expand_channel_meta from 'debug' to 'debug' 2024-01-24T15:34:53.533 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:34:53 smithi160 ceph-mon[38982]: expand_channel_meta expanded map: {default=debug} 2024-01-24T15:34:58.256 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:58.254+0000 7efea6a00700 1 -- 172.21.15.204:0/877693138 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1270 (secure 0 0 0) 0x7efe98010380 con 0x7efeb0198520 2024-01-24T15:34:58.257 INFO:teuthology.orchestra.run.smithi204.stdout: 2024-01-24T15:34:58.257 INFO:teuthology.orchestra.run.smithi204.stdout:{"epoch":3,"fsid":"bede0bb6-bacd-11ee-95b1-87774f69a715","modified":"2024-01-24T15:34:53.242375Z","created":"2024-01-24T15:33:10.895521Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:3300","nonce":0},{"type":"v1","addr":"172.21.15.204:6789","nonce":0}]},"addr":"172.21.15.204:6789/0","public_addr":"172.21.15.204:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:3300","nonce":0},{"type":"v1","addr":"172.21.15.160:6789","nonce":0}]},"addr":"172.21.15.160:6789/0","public_addr":"172.21.15.160:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-01-24T15:34:58.260 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:58.258+0000 7efeb5200700 1 -- 172.21.15.204:0/877693138 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7efe900381e0 msgr2=0x7efe9003a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:58.260 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:58.258+0000 7efeb5200700 1 --2- 172.21.15.204:0/877693138 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7efe900381e0 0x7efe9003a6a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efea00092e0 tx=0x7efea000b580 comp rx=0 tx=0).stop 2024-01-24T15:34:58.260 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:58.258+0000 7efeb5200700 1 -- 172.21.15.204:0/877693138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb0198520 msgr2=0x7efeb019c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:34:58.260 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:58.258+0000 7efeb5200700 1 --2- 172.21.15.204:0/877693138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb0198520 0x7efeb019c990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efe9800b4d0 tx=0x7efe9800b890 comp rx=0 tx=0).stop 2024-01-24T15:34:58.260 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:58.258+0000 7efeb5200700 1 -- 172.21.15.204:0/877693138 shutdown_connections 2024-01-24T15:34:58.260 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:58.258+0000 7efeb5200700 1 --2- 172.21.15.204:0/877693138 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7efeb01068e0 0x7efeb0197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:58.260 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:58.258+0000 7efeb5200700 1 --2- 172.21.15.204:0/877693138 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7efe900381e0 0x7efe9003a6a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:58.260 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:58.258+0000 7efeb5200700 1 --2- 172.21.15.204:0/877693138 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efeb0198520 0x7efeb019c990 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:34:58.261 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:58.258+0000 7efeb5200700 1 -- 172.21.15.204:0/877693138 >> 172.21.15.204:0/877693138 conn(0x7efeb00fc3b0 msgr2=0x7efeb0108e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:34:58.261 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:58.258+0000 7efeb5200700 1 -- 172.21.15.204:0/877693138 shutdown_connections 2024-01-24T15:34:58.261 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:34:58.258+0000 7efeb5200700 1 -- 172.21.15.204:0/877693138 wait complete. 2024-01-24T15:34:58.261 INFO:teuthology.orchestra.run.smithi204.stderr:dumped monmap epoch 3 2024-01-24T15:34:58.545 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:58.545 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-24T15:34:58.546 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:34:58.546 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: mon.a calling monitor election 2024-01-24T15:34:58.546 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: mon.c calling monitor election 2024-01-24T15:34:58.546 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:34:58.546 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: from='client.? 172.21.15.204:0/877693138' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-24T15:34:58.546 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:34:58.546 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:58.546 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:34:58.546 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:34:58.546 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:58.546 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:34:58.547 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:34:58.547 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-01-24T15:34:58.547 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0],c=[v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-24T15:34:58.547 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: fsmap 2024-01-24T15:34:58.547 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: osdmap e4: 0 total, 0 up, 0 in 2024-01-24T15:34:58.547 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: mgrmap e13: x(active, since 51s) 2024-01-24T15:34:58.547 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-01-24T15:34:58.547 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-01-24T15:34:58.547 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-01-24T15:34:58.547 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: mon.b (rank 2) addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] is down (out of quorum) 2024-01-24T15:34:58.547 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:58.547 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:58.548 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:58.548 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:58 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:58.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:58.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-24T15:34:58.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:34:58.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: mon.a calling monitor election 2024-01-24T15:34:58.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: mon.c calling monitor election 2024-01-24T15:34:58.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:34:58.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: from='client.? 172.21.15.204:0/877693138' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-24T15:34:58.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:34:58.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:58.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:34:58.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:34:58.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:34:58.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:34:58.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:34:58.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-01-24T15:34:58.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0],c=[v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-24T15:34:58.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: fsmap 2024-01-24T15:34:58.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: osdmap e4: 0 total, 0 up, 0 in 2024-01-24T15:34:58.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: mgrmap e13: x(active, since 51s) 2024-01-24T15:34:58.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-01-24T15:34:58.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-01-24T15:34:58.685 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-01-24T15:34:58.685 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: mon.b (rank 2) addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] is down (out of quorum) 2024-01-24T15:34:58.685 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:58.685 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:58.685 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:58.685 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:58 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:34:58.757 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-01-24T15:34:58.757 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph config generate-minimal-conf 2024-01-24T15:34:59.115 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.a/config 2024-01-24T15:34:59.543 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:59 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:34:59.543 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:34:59 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:34:59.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:59 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:34:59.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:34:59 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:35:00.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.147+0000 7f21c4e00700 1 -- 172.21.15.5:0/997173357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c0073170 msgr2=0x7f21c0073550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:35:00.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.147+0000 7f21c4e00700 1 --2- 172.21.15.5:0/997173357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c0073170 0x7f21c0073550 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f21b0009910 tx=0x7f21b0009c20 comp rx=0 tx=0).stop 2024-01-24T15:35:00.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.147+0000 7f21c4e00700 1 -- 172.21.15.5:0/997173357 shutdown_connections 2024-01-24T15:35:00.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.147+0000 7f21c4e00700 1 --2- 172.21.15.5:0/997173357 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c0073170 0x7f21c0073550 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:00.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.147+0000 7f21c4e00700 1 -- 172.21.15.5:0/997173357 >> 172.21.15.5:0/997173357 conn(0x7f21c00fc300 msgr2=0x7f21c00fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:35:00.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.148+0000 7f21c4e00700 1 -- 172.21.15.5:0/997173357 shutdown_connections 2024-01-24T15:35:00.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.148+0000 7f21c4e00700 1 -- 172.21.15.5:0/997173357 wait complete. 2024-01-24T15:35:00.150 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.149+0000 7f21c4e00700 1 Processor -- start 2024-01-24T15:35:00.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.149+0000 7f21c4e00700 1 -- start start 2024-01-24T15:35:00.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.149+0000 7f21c4e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c0073170 0x7f21c0198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:35:00.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.149+0000 7f21c4e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21c0198590 0x7f21c019ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:35:00.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.149+0000 7f21c4e00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21c019cf40 0x7f21c019d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:35:00.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.149+0000 7f21c4e00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c0198c80 con 0x7f21c0073170 2024-01-24T15:35:00.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.149+0000 7f21c4e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c01a4cb0 con 0x7f21c0198590 2024-01-24T15:35:00.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.149+0000 7f21c4e00700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c01a4df0 con 0x7f21c019cf40 2024-01-24T15:35:00.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.149+0000 7f21bde00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c0073170 0x7f21c0198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:35:00.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.150+0000 7f21bde00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c0073170 0x7f21c0198050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52514/0 (socket says 172.21.15.5:52514) 2024-01-24T15:35:00.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.150+0000 7f21bde00700 1 -- 172.21.15.5:0/406040299 learned_addr learned my addr 172.21.15.5:0/406040299 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:35:00.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.150+0000 7f21bd400700 1 --2- 172.21.15.5:0/406040299 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21c0198590 0x7f21c019ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:35:00.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.150+0000 7f21be800700 1 --2- 172.21.15.5:0/406040299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21c019cf40 0x7f21c019d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:35:00.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.150+0000 7f21bd400700 1 -- 172.21.15.5:0/406040299 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21c0198590 msgr2=0x7f21c019ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-01-24T15:35:00.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.150+0000 7f21bd400700 1 -- 172.21.15.5:0/406040299 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21c0198590 msgr2=0x7f21c019ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-01-24T15:35:00.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.150+0000 7f21bd400700 1 --2- 172.21.15.5:0/406040299 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21c0198590 0x7f21c019ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-24T15:35:00.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.150+0000 7f21bde00700 1 -- 172.21.15.5:0/406040299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21c019cf40 msgr2=0x7f21c019d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:35:00.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.150+0000 7f21bde00700 1 --2- 172.21.15.5:0/406040299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21c019cf40 0x7f21c019d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:00.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.150+0000 7f21bd400700 1 --2- 172.21.15.5:0/406040299 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21c0198590 0x7f21c019ca00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-24T15:35:00.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.150+0000 7f21bde00700 1 -- 172.21.15.5:0/406040299 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21c0198590 msgr2=0x7f21c019ca00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-24T15:35:00.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.150+0000 7f21bde00700 1 --2- 172.21.15.5:0/406040299 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21c0198590 0x7f21c019ca00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:00.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.150+0000 7f21bde00700 1 -- 172.21.15.5:0/406040299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b00095f0 con 0x7f21c0073170 2024-01-24T15:35:00.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.150+0000 7f21bde00700 1 --2- 172.21.15.5:0/406040299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c0073170 0x7f21c0198050 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f21b000bca0 tx=0x7f21b000bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:35:00.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.151+0000 7f21b6a00700 1 -- 172.21.15.5:0/406040299 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b001d070 con 0x7f21c0073170 2024-01-24T15:35:00.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.151+0000 7f21b6a00700 1 -- 172.21.15.5:0/406040299 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f21b0004db0 con 0x7f21c0073170 2024-01-24T15:35:00.154 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.151+0000 7f21c4e00700 1 -- 172.21.15.5:0/406040299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c01a5070 con 0x7f21c0073170 2024-01-24T15:35:00.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.151+0000 7f21b6a00700 1 -- 172.21.15.5:0/406040299 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0022d40 con 0x7f21c0073170 2024-01-24T15:35:00.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.151+0000 7f21c4e00700 1 -- 172.21.15.5:0/406040299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c01a5560 con 0x7f21c0073170 2024-01-24T15:35:00.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.152+0000 7f21c4e00700 1 -- 172.21.15.5:0/406040299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c010a1d0 con 0x7f21c0073170 2024-01-24T15:35:00.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.152+0000 7f21b6a00700 1 -- 172.21.15.5:0/406040299 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) v1 ==== 45323+0+0 (secure 0 0 0) 0x7f21b0022500 con 0x7f21c0073170 2024-01-24T15:35:00.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.153+0000 7f21b6a00700 1 --2- 172.21.15.5:0/406040299 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f21a0038870 0x7f21a003ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:35:00.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.153+0000 7f21b6a00700 1 -- 172.21.15.5:0/406040299 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f21b004c3d0 con 0x7f21c0073170 2024-01-24T15:35:00.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.153+0000 7f21bd400700 1 --2- 172.21.15.5:0/406040299 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f21a0038870 0x7f21a003ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:35:00.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.154+0000 7f21bd400700 1 --2- 172.21.15.5:0/406040299 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f21a0038870 0x7f21a003ad30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f21a8009850 tx=0x7f21a8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:35:00.160 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.158+0000 7f21b6a00700 1 -- 172.21.15.5:0/406040299 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f21b000e850 con 0x7f21c0073170 2024-01-24T15:35:00.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.376+0000 7f21c4e00700 1 -- 172.21.15.5:0/406040299 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f21c0062370 con 0x7f21c0073170 2024-01-24T15:35:00.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.376+0000 7f21b6a00700 1 -- 172.21.15.5:0/406040299 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+273 (secure 0 0 0) 0x7f21b0027020 con 0x7f21c0073170 2024-01-24T15:35:00.378 INFO:teuthology.orchestra.run.smithi005.stdout:# minimal ceph.conf for bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:35:00.378 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-01-24T15:35:00.378 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:35:00.378 INFO:teuthology.orchestra.run.smithi005.stdout: mon_host = [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] 2024-01-24T15:35:00.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.379+0000 7f21c4e00700 1 -- 172.21.15.5:0/406040299 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f21a0038870 msgr2=0x7f21a003ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:35:00.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.379+0000 7f21c4e00700 1 --2- 172.21.15.5:0/406040299 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f21a0038870 0x7f21a003ad30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f21a8009850 tx=0x7f21a8008040 comp rx=0 tx=0).stop 2024-01-24T15:35:00.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.379+0000 7f21c4e00700 1 -- 172.21.15.5:0/406040299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c0073170 msgr2=0x7f21c0198050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:35:00.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.379+0000 7f21c4e00700 1 --2- 172.21.15.5:0/406040299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c0073170 0x7f21c0198050 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f21b000bca0 tx=0x7f21b000bd80 comp rx=0 tx=0).stop 2024-01-24T15:35:00.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.379+0000 7f21c4e00700 1 -- 172.21.15.5:0/406040299 shutdown_connections 2024-01-24T15:35:00.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.379+0000 7f21c4e00700 1 --2- 172.21.15.5:0/406040299 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f21c019cf40 0x7f21c019d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:00.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.379+0000 7f21c4e00700 1 --2- 172.21.15.5:0/406040299 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f21a0038870 0x7f21a003ad30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:00.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.379+0000 7f21c4e00700 1 --2- 172.21.15.5:0/406040299 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f21c0073170 0x7f21c0198050 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:00.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.379+0000 7f21c4e00700 1 --2- 172.21.15.5:0/406040299 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21c0198590 0x7f21c019ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:00.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.379+0000 7f21c4e00700 1 -- 172.21.15.5:0/406040299 >> 172.21.15.5:0/406040299 conn(0x7f21c00fc300 msgr2=0x7f21c0107310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:35:00.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.379+0000 7f21c4e00700 1 -- 172.21.15.5:0/406040299 shutdown_connections 2024-01-24T15:35:00.381 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:00.379+0000 7f21c4e00700 1 -- 172.21.15.5:0/406040299 wait complete. 2024-01-24T15:35:00.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:00.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-24T15:35:00.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:35:00.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: mon.a calling monitor election 2024-01-24T15:35:00.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: mon.c calling monitor election 2024-01-24T15:35:00.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:35:00.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: from='client.? 172.21.15.204:0/877693138' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-24T15:35:00.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:35:00.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:00.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:35:00.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:35:00.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:00.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:35:00.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:35:00.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-01-24T15:35:00.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0],c=[v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-24T15:35:00.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: fsmap 2024-01-24T15:35:00.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: osdmap e4: 0 total, 0 up, 0 in 2024-01-24T15:35:00.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: mgrmap e13: x(active, since 51s) 2024-01-24T15:35:00.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-01-24T15:35:00.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-01-24T15:35:00.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-01-24T15:35:00.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: mon.b (rank 2) addr [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] is down (out of quorum) 2024-01-24T15:35:00.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:00.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:00.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:00.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:00.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:35:00.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:35:00.708 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-01-24T15:35:00.709 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-01-24T15:35:00.709 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.conf 2024-01-24T15:35:00.781 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-01-24T15:35:00.781 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-01-24T15:35:00.890 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-01-24T15:35:00.890 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/ceph/ceph.conf 2024-01-24T15:35:00.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:00 smithi005 ceph-mon[35346]: mon.b calling monitor election 2024-01-24T15:35:00.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:00 smithi005 ceph-mon[35346]: Updating smithi005:/etc/ceph/ceph.conf 2024-01-24T15:35:00.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:00 smithi005 ceph-mon[35346]: Updating smithi160:/etc/ceph/ceph.conf 2024-01-24T15:35:00.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:00 smithi005 ceph-mon[35346]: Updating smithi204:/etc/ceph/ceph.conf 2024-01-24T15:35:00.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:00 smithi005 ceph-mon[35346]: mon.b calling monitor election 2024-01-24T15:35:00.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:00 smithi005 ceph-mon[35346]: mon.c calling monitor election 2024-01-24T15:35:00.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:00 smithi005 ceph-mon[35346]: mon.a calling monitor election 2024-01-24T15:35:00.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:00 smithi005 ceph-mon[35346]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-01-24T15:35:00.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:00 smithi005 ceph-mon[35346]: monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0],c=[v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-24T15:35:00.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:00 smithi005 ceph-mon[35346]: fsmap 2024-01-24T15:35:00.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:00 smithi005 ceph-mon[35346]: osdmap e4: 0 total, 0 up, 0 in 2024-01-24T15:35:00.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:00 smithi005 ceph-mon[35346]: mgrmap e13: x(active, since 53s) 2024-01-24T15:35:00.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:00 smithi005 ceph-mon[35346]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-01-24T15:35:00.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:00 smithi005 ceph-mon[35346]: Cluster is now healthy 2024-01-24T15:35:00.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:00 smithi005 ceph-mon[35346]: overall HEALTH_OK 2024-01-24T15:35:00.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:00 smithi005 ceph-mon[35346]: Updating smithi005:/var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/config/ceph.conf 2024-01-24T15:35:00.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:00 smithi005 ceph-mon[35346]: Updating smithi160:/var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/config/ceph.conf 2024-01-24T15:35:00.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:00 smithi005 ceph-mon[35346]: Updating smithi204:/var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/config/ceph.conf 2024-01-24T15:35:00.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:00 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/406040299' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:00.958 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-01-24T15:35:00.959 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-01-24T15:35:01.059 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: mon.b calling monitor election 2024-01-24T15:35:01.060 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: Updating smithi005:/etc/ceph/ceph.conf 2024-01-24T15:35:01.060 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: Updating smithi160:/etc/ceph/ceph.conf 2024-01-24T15:35:01.060 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: Updating smithi204:/etc/ceph/ceph.conf 2024-01-24T15:35:01.060 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: mon.b calling monitor election 2024-01-24T15:35:01.060 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: mon.c calling monitor election 2024-01-24T15:35:01.060 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: mon.a calling monitor election 2024-01-24T15:35:01.060 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-01-24T15:35:01.060 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0],c=[v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-24T15:35:01.060 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: fsmap 2024-01-24T15:35:01.060 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: osdmap e4: 0 total, 0 up, 0 in 2024-01-24T15:35:01.060 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: mgrmap e13: x(active, since 53s) 2024-01-24T15:35:01.060 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-01-24T15:35:01.060 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: Cluster is now healthy 2024-01-24T15:35:01.061 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: overall HEALTH_OK 2024-01-24T15:35:01.061 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: Updating smithi005:/var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/config/ceph.conf 2024-01-24T15:35:01.061 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: Updating smithi160:/var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/config/ceph.conf 2024-01-24T15:35:01.061 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: Updating smithi204:/var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/config/ceph.conf 2024-01-24T15:35:01.061 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:00 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/406040299' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:01.068 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-01-24T15:35:01.068 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/ceph/ceph.conf 2024-01-24T15:35:01.129 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:00 smithi204 ceph-mon[39634]: mon.b calling monitor election 2024-01-24T15:35:01.129 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:00 smithi204 ceph-mon[39634]: Updating smithi005:/etc/ceph/ceph.conf 2024-01-24T15:35:01.129 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:00 smithi204 ceph-mon[39634]: Updating smithi160:/etc/ceph/ceph.conf 2024-01-24T15:35:01.129 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:00 smithi204 ceph-mon[39634]: Updating smithi204:/etc/ceph/ceph.conf 2024-01-24T15:35:01.129 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:00 smithi204 ceph-mon[39634]: mon.b calling monitor election 2024-01-24T15:35:01.129 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:00 smithi204 ceph-mon[39634]: mon.c calling monitor election 2024-01-24T15:35:01.129 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:00 smithi204 ceph-mon[39634]: mon.a calling monitor election 2024-01-24T15:35:01.129 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:00 smithi204 ceph-mon[39634]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-01-24T15:35:01.129 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:00 smithi204 ceph-mon[39634]: monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0],c=[v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-24T15:35:01.129 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:00 smithi204 ceph-mon[39634]: fsmap 2024-01-24T15:35:01.130 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:00 smithi204 ceph-mon[39634]: osdmap e4: 0 total, 0 up, 0 in 2024-01-24T15:35:01.130 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:00 smithi204 ceph-mon[39634]: mgrmap e13: x(active, since 53s) 2024-01-24T15:35:01.130 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:00 smithi204 ceph-mon[39634]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-01-24T15:35:01.130 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:00 smithi204 ceph-mon[39634]: Cluster is now healthy 2024-01-24T15:35:01.130 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:00 smithi204 ceph-mon[39634]: overall HEALTH_OK 2024-01-24T15:35:01.130 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:00 smithi204 ceph-mon[39634]: Updating smithi005:/var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/config/ceph.conf 2024-01-24T15:35:01.130 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:00 smithi204 ceph-mon[39634]: Updating smithi160:/var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/config/ceph.conf 2024-01-24T15:35:01.130 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:00 smithi204 ceph-mon[39634]: Updating smithi204:/var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/config/ceph.conf 2024-01-24T15:35:01.130 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:00 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/406040299' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:01.139 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-01-24T15:35:01.139 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-01-24T15:35:01.245 INFO:tasks.cephadm:Adding mgr.x on smithi005 2024-01-24T15:35:01.245 INFO:tasks.cephadm:Adding mgr.y on smithi160 2024-01-24T15:35:01.245 INFO:tasks.cephadm:Adding mgr.z on smithi204 2024-01-24T15:35:01.245 DEBUG:teuthology.orchestra.run.smithi204:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph orch apply mgr '3;smithi005=x;smithi160=y;smithi204=z' 2024-01-24T15:35:01.625 INFO:teuthology.orchestra.run.smithi204.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.c/config 2024-01-24T15:35:02.101 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:01 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.101 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:01 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.101 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:01 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.101 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:01 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.101 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:01 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.101 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:01 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.101 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:01 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.102 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:01 smithi005 ceph-mon[35346]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:02.102 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:01 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.102 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:01 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.102 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:01 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.102 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:01 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.102 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:01 smithi005 ceph-mon[35346]: Reconfiguring mon.a (unknown last config time)... 2024-01-24T15:35:02.102 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:01 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-24T15:35:02.102 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:01 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-24T15:35:02.102 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:01 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:02.102 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:01 smithi005 ceph-mon[35346]: Reconfiguring daemon mon.a on smithi005 2024-01-24T15:35:02.102 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:01 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:35:02.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:01 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:01 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:01 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:01 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:01 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:01 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:01 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:01 smithi204 ceph-mon[39634]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:02.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:01 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:01 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:01 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:01 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:01 smithi204 ceph-mon[39634]: Reconfiguring mon.a (unknown last config time)... 2024-01-24T15:35:02.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:01 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-24T15:35:02.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:01 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-24T15:35:02.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:01 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:02.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:01 smithi204 ceph-mon[39634]: Reconfiguring daemon mon.a on smithi005 2024-01-24T15:35:02.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:01 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:35:02.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:01 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:01 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:01 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:01 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:01 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:01 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:01 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:01 smithi160 ceph-mon[38982]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:02.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:01 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:01 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:01 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:01 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:02.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:01 smithi160 ceph-mon[38982]: Reconfiguring mon.a (unknown last config time)... 2024-01-24T15:35:02.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:01 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-24T15:35:02.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:01 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-24T15:35:02.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:01 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:02.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:01 smithi160 ceph-mon[38982]: Reconfiguring daemon mon.a on smithi005 2024-01-24T15:35:02.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:01 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:35:02.996 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.994+0000 7fdd5c000700 1 -- 172.21.15.204:0/105282936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd54100970 msgr2=0x7fdd54100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:35:02.996 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.994+0000 7fdd5c000700 1 --2- 172.21.15.204:0/105282936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd54100970 0x7fdd54100d90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdd44009910 tx=0x7fdd44009c20 comp rx=0 tx=0).stop 2024-01-24T15:35:02.996 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.994+0000 7fdd5c000700 1 -- 172.21.15.204:0/105282936 shutdown_connections 2024-01-24T15:35:02.996 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.994+0000 7fdd5c000700 1 --2- 172.21.15.204:0/105282936 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd54100970 0x7fdd54100d90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:02.996 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.994+0000 7fdd5c000700 1 -- 172.21.15.204:0/105282936 >> 172.21.15.204:0/105282936 conn(0x7fdd540fbf10 msgr2=0x7fdd540fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:35:02.997 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.994+0000 7fdd5c000700 1 -- 172.21.15.204:0/105282936 shutdown_connections 2024-01-24T15:35:02.997 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.994+0000 7fdd5c000700 1 -- 172.21.15.204:0/105282936 wait complete. 2024-01-24T15:35:02.998 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.995+0000 7fdd5c000700 1 Processor -- start 2024-01-24T15:35:02.998 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.995+0000 7fdd5c000700 1 -- start start 2024-01-24T15:35:02.998 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.996+0000 7fdd5c000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd54100970 0x7fdd54195bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:35:02.998 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.996+0000 7fdd5c000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd541960f0 0x7fdd5419b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:35:02.998 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.996+0000 7fdd5c000700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdd54196570 0x7fdd5419d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:35:02.998 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.996+0000 7fdd5c000700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5419de90 con 0x7fdd54100970 2024-01-24T15:35:02.998 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.996+0000 7fdd5c000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5419e000 con 0x7fdd541960f0 2024-01-24T15:35:02.999 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.996+0000 7fdd5c000700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5419e1c0 con 0x7fdd54196570 2024-01-24T15:35:02.999 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.996+0000 7fdd5a000700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdd54196570 0x7fdd5419d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:35:02.999 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.996+0000 7fdd5a000700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdd54196570 0x7fdd5419d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:36154/0 (socket says 172.21.15.204:36154) 2024-01-24T15:35:02.999 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.996+0000 7fdd5a000700 1 -- 172.21.15.204:0/2815786640 learned_addr learned my addr 172.21.15.204:0/2815786640 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-01-24T15:35:02.999 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.996+0000 7fdd58c00700 1 --2- 172.21.15.204:0/2815786640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd541960f0 0x7fdd5419b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:35:02.999 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.996+0000 7fdd59600700 1 --2- 172.21.15.204:0/2815786640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd54100970 0x7fdd54195bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:35:02.999 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.996+0000 7fdd5a000700 1 -- 172.21.15.204:0/2815786640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd541960f0 msgr2=0x7fdd5419b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:35:02.999 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.996+0000 7fdd5a000700 1 --2- 172.21.15.204:0/2815786640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd541960f0 0x7fdd5419b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:02.999 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.996+0000 7fdd5a000700 1 -- 172.21.15.204:0/2815786640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd54100970 msgr2=0x7fdd54195bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:35:02.999 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.996+0000 7fdd5a000700 1 --2- 172.21.15.204:0/2815786640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd54100970 0x7fdd54195bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:02.999 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.996+0000 7fdd5a000700 1 -- 172.21.15.204:0/2815786640 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd440095f0 con 0x7fdd54196570 2024-01-24T15:35:02.999 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.997+0000 7fdd5a000700 1 --2- 172.21.15.204:0/2815786640 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdd54196570 0x7fdd5419d6f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c00ba50 tx=0x7fdd4c00bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:35:03.000 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.997+0000 7fdd52000700 1 -- 172.21.15.204:0/2815786640 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c00c930 con 0x7fdd54196570 2024-01-24T15:35:03.000 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.997+0000 7fdd52000700 1 -- 172.21.15.204:0/2815786640 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd4c014440 con 0x7fdd54196570 2024-01-24T15:35:03.001 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.997+0000 7fdd5c000700 1 -- 172.21.15.204:0/2815786640 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd5419e4a0 con 0x7fdd54196570 2024-01-24T15:35:03.001 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.997+0000 7fdd52000700 1 -- 172.21.15.204:0/2815786640 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c0075b0 con 0x7fdd54196570 2024-01-24T15:35:03.001 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.997+0000 7fdd5c000700 1 -- 172.21.15.204:0/2815786640 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd5419ea20 con 0x7fdd54196570 2024-01-24T15:35:03.001 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.998+0000 7fdd52000700 1 -- 172.21.15.204:0/2815786640 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 13) v1 ==== 45323+0+0 (secure 0 0 0) 0x7fdd4c0145b0 con 0x7fdd54196570 2024-01-24T15:35:03.001 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.998+0000 7fdd5c000700 1 -- 172.21.15.204:0/2815786640 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd5418f330 con 0x7fdd54196570 2024-01-24T15:35:03.001 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.999+0000 7fdd52000700 1 --2- 172.21.15.204:0/2815786640 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fdd34038870 0x7fdd3403ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:35:03.001 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.999+0000 7fdd52000700 1 -- 172.21.15.204:0/2815786640 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fdd4c04a5a0 con 0x7fdd54196570 2024-01-24T15:35:03.001 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:02.999+0000 7fdd59600700 1 --2- 172.21.15.204:0/2815786640 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fdd34038870 0x7fdd3403ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:35:03.001 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:03.000+0000 7fdd59600700 1 --2- 172.21.15.204:0/2815786640 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fdd34038870 0x7fdd3403ad30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdd44006010 tx=0x7fdd440058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:35:03.006 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:03.004+0000 7fdd52000700 1 -- 172.21.15.204:0/2815786640 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7fdd4c0139f0 con 0x7fdd54196570 2024-01-24T15:35:03.211 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:03.210+0000 7fdd5c000700 1 -- 172.21.15.204:0/2815786640 --> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi005=x;smithi160=y;smithi204=z", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd54061210 con 0x7fdd34038870 2024-01-24T15:35:03.218 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:03.217+0000 7fdd52000700 1 -- 172.21.15.204:0/2815786640 <== mgr.14150 v2:172.21.15.5:6800/1971309753 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fdd54061210 con 0x7fdd34038870 2024-01-24T15:35:03.218 INFO:teuthology.orchestra.run.smithi204.stdout:Scheduled mgr update... 2024-01-24T15:35:03.221 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:03.219+0000 7fdd5c000700 1 -- 172.21.15.204:0/2815786640 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fdd34038870 msgr2=0x7fdd3403ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:35:03.221 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:03.219+0000 7fdd5c000700 1 --2- 172.21.15.204:0/2815786640 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fdd34038870 0x7fdd3403ad30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdd44006010 tx=0x7fdd440058e0 comp rx=0 tx=0).stop 2024-01-24T15:35:03.221 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:03.219+0000 7fdd5c000700 1 -- 172.21.15.204:0/2815786640 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdd54196570 msgr2=0x7fdd5419d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:35:03.221 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:03.219+0000 7fdd5c000700 1 --2- 172.21.15.204:0/2815786640 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdd54196570 0x7fdd5419d6f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c00ba50 tx=0x7fdd4c00bd60 comp rx=0 tx=0).stop 2024-01-24T15:35:03.221 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:03.219+0000 7fdd5c000700 1 -- 172.21.15.204:0/2815786640 shutdown_connections 2024-01-24T15:35:03.221 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:03.219+0000 7fdd5c000700 1 --2- 172.21.15.204:0/2815786640 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fdd54196570 0x7fdd5419d6f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:03.221 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:03.219+0000 7fdd5c000700 1 --2- 172.21.15.204:0/2815786640 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fdd34038870 0x7fdd3403ad30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:03.221 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:03.219+0000 7fdd5c000700 1 --2- 172.21.15.204:0/2815786640 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdd54100970 0x7fdd54195bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:03.221 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:03.219+0000 7fdd5c000700 1 --2- 172.21.15.204:0/2815786640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd541960f0 0x7fdd5419b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:03.221 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:03.219+0000 7fdd5c000700 1 -- 172.21.15.204:0/2815786640 >> 172.21.15.204:0/2815786640 conn(0x7fdd540fbf10 msgr2=0x7fdd540fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:35:03.222 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:03.219+0000 7fdd5c000700 1 -- 172.21.15.204:0/2815786640 shutdown_connections 2024-01-24T15:35:03.222 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:03.219+0000 7fdd5c000700 1 -- 172.21.15.204:0/2815786640 wait complete. 2024-01-24T15:35:03.474 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:03 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:03.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:03 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:03.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:03 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:03.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:03 smithi204 ceph-mon[39634]: Reconfiguring mon.b (monmap changed)... 2024-01-24T15:35:03.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:03 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-24T15:35:03.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:03 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-24T15:35:03.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:03 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:03.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:03 smithi204 ceph-mon[39634]: Reconfiguring daemon mon.b on smithi160 2024-01-24T15:35:03.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:03 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:03.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:03 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:03.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:03 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:03.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:03 smithi160 ceph-mon[38982]: Reconfiguring mon.b (monmap changed)... 2024-01-24T15:35:03.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:03 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-24T15:35:03.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:03 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-24T15:35:03.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:03 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:03.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:03 smithi160 ceph-mon[38982]: Reconfiguring daemon mon.b on smithi160 2024-01-24T15:35:03.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:03 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:03.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:03 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:03.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:03 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:03.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:03 smithi005 ceph-mon[35346]: Reconfiguring mon.b (monmap changed)... 2024-01-24T15:35:03.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:03 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-24T15:35:03.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:03 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-24T15:35:03.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:03 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:03.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:03 smithi005 ceph-mon[35346]: Reconfiguring daemon mon.b on smithi160 2024-01-24T15:35:03.778 DEBUG:teuthology.orchestra.run.smithi160:mgr.y> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mgr.y.service 2024-01-24T15:35:03.783 DEBUG:teuthology.orchestra.run.smithi204:mgr.z> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mgr.z.service 2024-01-24T15:35:03.787 INFO:tasks.cephadm:Deploying OSDs... 2024-01-24T15:35:03.787 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-01-24T15:35:03.787 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2024-01-24T15:35:03.834 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-24T15:35:03.834 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2024-01-24T15:35:03.849 INFO:journalctl@ceph.mgr.y.smithi160.stdout:-- Logs begin at Wed 2024-01-24 15:17:12 UTC. -- 2024-01-24T15:35:03.856 INFO:journalctl@ceph.mgr.z.smithi204.stdout:-- Logs begin at Wed 2024-01-24 15:17:05 UTC. -- 2024-01-24T15:35:03.919 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-24T15:35:03.919 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T15:35:03.919 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 452 Links: 1 2024-01-24T15:35:03.919 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T15:35:03.919 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-01-24T15:35:03.919 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-01-24 15:34:17.185502899 +0000 2024-01-24T15:35:03.919 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-01-24 15:27:35.285087698 +0000 2024-01-24T15:35:03.919 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-01-24 15:27:35.285087698 +0000 2024-01-24T15:35:03.920 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-01-24 15:27:35.264088155 +0000 2024-01-24T15:35:03.920 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-24T15:35:04.026 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-01-24T15:35:04.026 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-01-24T15:35:04.026 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000180018 s, 2.8 MB/s 2024-01-24T15:35:04.028 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-24T15:35:04.072 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2024-01-24T15:35:04.153 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-24T15:35:04.154 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T15:35:04.154 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 458 Links: 1 2024-01-24T15:35:04.154 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T15:35:04.154 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-01-24T15:35:04.154 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-01-24 15:34:17.267501111 +0000 2024-01-24T15:35:04.154 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-01-24 15:27:35.763077290 +0000 2024-01-24T15:35:04.154 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-01-24 15:27:35.763077290 +0000 2024-01-24T15:35:04.154 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-01-24 15:27:35.742077747 +0000 2024-01-24T15:35:04.154 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-24T15:35:04.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-01-24T15:35:04.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-01-24T15:35:04.257 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000177024 s, 2.9 MB/s 2024-01-24T15:35:04.259 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-24T15:35:04.302 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2024-01-24T15:35:04.382 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:04 smithi204 ceph-mon[39634]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:04.382 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:04 smithi204 ceph-mon[39634]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi005=x;smithi160=y;smithi204=z", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:35:04.382 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:04 smithi204 ceph-mon[39634]: Saving service mgr spec with placement smithi005=x;smithi160=y;smithi204=z;count:3 2024-01-24T15:35:04.382 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:04 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:04.382 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:04 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:04.382 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:04 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:04.382 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:04 smithi204 ceph-mon[39634]: Reconfiguring mon.c (monmap changed)... 2024-01-24T15:35:04.382 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:04 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-24T15:35:04.382 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:04 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-24T15:35:04.382 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:04 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:04.382 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:04 smithi204 ceph-mon[39634]: Reconfiguring daemon mon.c on smithi204 2024-01-24T15:35:04.383 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-24T15:35:04.384 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T15:35:04.384 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 464 Links: 1 2024-01-24T15:35:04.384 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T15:35:04.384 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-01-24T15:35:04.384 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-01-24 15:34:17.353499236 +0000 2024-01-24T15:35:04.384 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-01-24 15:27:36.223067274 +0000 2024-01-24T15:35:04.384 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-01-24 15:27:36.223067274 +0000 2024-01-24T15:35:04.384 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-01-24 15:27:36.202067731 +0000 2024-01-24T15:35:04.384 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-24T15:35:04.432 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:04 smithi005 ceph-mon[35346]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:04.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:04 smithi005 ceph-mon[35346]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi005=x;smithi160=y;smithi204=z", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:35:04.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:04 smithi005 ceph-mon[35346]: Saving service mgr spec with placement smithi005=x;smithi160=y;smithi204=z;count:3 2024-01-24T15:35:04.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:04 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:04.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:04 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:04.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:04 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:04.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:04 smithi005 ceph-mon[35346]: Reconfiguring mon.c (monmap changed)... 2024-01-24T15:35:04.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:04 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-24T15:35:04.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:04 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-24T15:35:04.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:04 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:04.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:04 smithi005 ceph-mon[35346]: Reconfiguring daemon mon.c on smithi204 2024-01-24T15:35:04.486 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-01-24T15:35:04.486 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-01-24T15:35:04.486 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000175472 s, 2.9 MB/s 2024-01-24T15:35:04.489 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-24T15:35:04.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:04 smithi160 ceph-mon[38982]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:04.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:04 smithi160 ceph-mon[38982]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi005=x;smithi160=y;smithi204=z", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:35:04.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:04 smithi160 ceph-mon[38982]: Saving service mgr spec with placement smithi005=x;smithi160=y;smithi204=z;count:3 2024-01-24T15:35:04.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:04 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:04.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:04 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:04.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:04 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:04.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:04 smithi160 ceph-mon[38982]: Reconfiguring mon.c (monmap changed)... 2024-01-24T15:35:04.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:04 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-24T15:35:04.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:04 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-24T15:35:04.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:04 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:04.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:04 smithi160 ceph-mon[38982]: Reconfiguring daemon mon.c on smithi204 2024-01-24T15:35:04.572 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2024-01-24T15:35:04.655 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-24T15:35:04.655 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T15:35:04.655 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 470 Links: 1 2024-01-24T15:35:04.655 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T15:35:04.655 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-01-24T15:35:04.655 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-01-24 15:34:17.444497252 +0000 2024-01-24T15:35:04.655 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-01-24 15:27:36.689057127 +0000 2024-01-24T15:35:04.655 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-01-24 15:27:36.689057127 +0000 2024-01-24T15:35:04.655 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-01-24 15:27:36.667057606 +0000 2024-01-24T15:35:04.656 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-24T15:35:04.758 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-01-24T15:35:04.758 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-01-24T15:35:04.758 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000174137 s, 2.9 MB/s 2024-01-24T15:35:04.760 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-24T15:35:04.803 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-01-24T15:35:04.804 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/scratch_devs of=/dev/stdout 2024-01-24T15:35:04.848 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-24T15:35:04.848 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_1 2024-01-24T15:35:04.931 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-24T15:35:04.932 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T15:35:04.932 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 448 Links: 1 2024-01-24T15:35:04.932 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T15:35:04.932 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-01-24T15:35:04.932 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-01-24 15:34:52.606368163 +0000 2024-01-24T15:35:04.932 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-01-24 15:27:26.438584000 +0000 2024-01-24T15:35:04.932 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-01-24 15:27:26.438584000 +0000 2024-01-24T15:35:04.932 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-01-24 15:27:26.410584449 +0000 2024-01-24T15:35:04.932 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-24T15:35:05.037 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-01-24T15:35:05.037 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-01-24T15:35:05.037 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000482269 s, 1.1 MB/s 2024-01-24T15:35:05.039 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-24T15:35:05.082 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_2 2024-01-24T15:35:05.165 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-24T15:35:05.165 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T15:35:05.165 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 454 Links: 1 2024-01-24T15:35:05.165 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T15:35:05.165 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-01-24T15:35:05.165 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-01-24 15:34:52.606368163 +0000 2024-01-24T15:35:05.165 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-01-24 15:27:26.913576362 +0000 2024-01-24T15:35:05.166 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-01-24 15:27:26.913576362 +0000 2024-01-24T15:35:05.166 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-01-24 15:27:26.888576764 +0000 2024-01-24T15:35:05.166 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-24T15:35:05.267 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-01-24T15:35:05.267 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-01-24T15:35:05.267 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000272398 s, 1.9 MB/s 2024-01-24T15:35:05.270 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-24T15:35:05.312 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_3 2024-01-24T15:35:05.394 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-24T15:35:05.394 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T15:35:05.394 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 460 Links: 1 2024-01-24T15:35:05.394 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T15:35:05.394 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-01-24T15:35:05.394 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-01-24 15:34:52.606368163 +0000 2024-01-24T15:35:05.394 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-01-24 15:27:27.390568692 +0000 2024-01-24T15:35:05.395 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-01-24 15:27:27.390568692 +0000 2024-01-24T15:35:05.395 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-01-24 15:27:27.365569094 +0000 2024-01-24T15:35:05.395 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-24T15:35:05.496 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-01-24T15:35:05.496 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-01-24T15:35:05.496 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000361486 s, 1.4 MB/s 2024-01-24T15:35:05.499 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-24T15:35:05.541 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_4 2024-01-24T15:35:05.623 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-24T15:35:05.623 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T15:35:05.623 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 466 Links: 1 2024-01-24T15:35:05.623 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T15:35:05.623 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-01-24T15:35:05.623 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-01-24 15:34:52.607368148 +0000 2024-01-24T15:35:05.623 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-01-24 15:27:27.864561071 +0000 2024-01-24T15:35:05.624 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-01-24 15:27:27.864561071 +0000 2024-01-24T15:35:05.624 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-01-24 15:27:27.840561457 +0000 2024-01-24T15:35:05.624 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-24T15:35:05.726 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-01-24T15:35:05.726 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-01-24T15:35:05.726 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000311595 s, 1.6 MB/s 2024-01-24T15:35:05.729 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-24T15:35:05.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:05 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:05.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:05 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:05.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:05 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:35:05.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:05 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:05.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:05 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:35:05.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:05 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:05.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:05 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-24T15:35:05.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:05 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-01-24T15:35:05.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:05 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-24T15:35:05.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:05 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:05.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:05 smithi160 ceph-mon[38982]: Deploying daemon mgr.z on smithi204 2024-01-24T15:35:05.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:05 smithi160 ceph-mon[38982]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:05.772 DEBUG:teuthology.orchestra.run.smithi204:> set -ex 2024-01-24T15:35:05.772 DEBUG:teuthology.orchestra.run.smithi204:> dd if=/scratch_devs of=/dev/stdout 2024-01-24T15:35:05.813 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-24T15:35:05.813 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_1 2024-01-24T15:35:05.896 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-24T15:35:05.896 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T15:35:05.897 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 448 Links: 1 2024-01-24T15:35:05.897 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T15:35:05.897 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2024-01-24T15:35:05.897 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-01-24 15:34:43.950480342 +0000 2024-01-24T15:35:05.897 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-01-24 15:27:22.217588799 +0000 2024-01-24T15:35:05.897 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-01-24 15:27:22.217588799 +0000 2024-01-24T15:35:05.897 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-01-24 15:27:22.187589203 +0000 2024-01-24T15:35:05.897 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-24T15:35:05.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:05 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:05.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:05 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:05.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:05 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:35:05.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:05 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:05.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:05 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:35:05.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:05 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:05.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:05 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-24T15:35:05.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:05 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-01-24T15:35:05.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:05 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-24T15:35:05.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:05 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:05.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:05 smithi005 ceph-mon[35346]: Deploying daemon mgr.z on smithi204 2024-01-24T15:35:05.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:05 smithi005 ceph-mon[35346]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:05.974 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:05 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:05.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:05 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:05.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:05 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:35:05.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:05 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:05.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:05 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:35:05.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:05 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:05.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:05 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-24T15:35:05.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:05 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-01-24T15:35:05.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:05 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-24T15:35:05.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:05 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:05.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:05 smithi204 ceph-mon[39634]: Deploying daemon mgr.z on smithi204 2024-01-24T15:35:05.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:05 smithi204 ceph-mon[39634]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:06.002 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-01-24T15:35:06.002 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-01-24T15:35:06.002 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000317283 s, 1.6 MB/s 2024-01-24T15:35:06.005 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-24T15:35:06.091 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_2 2024-01-24T15:35:06.180 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-24T15:35:06.180 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T15:35:06.180 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 454 Links: 1 2024-01-24T15:35:06.180 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T15:35:06.180 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2024-01-24T15:35:06.180 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-01-24 15:34:43.951480328 +0000 2024-01-24T15:35:06.180 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-01-24 15:27:22.722582000 +0000 2024-01-24T15:35:06.180 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-01-24 15:27:22.722582000 +0000 2024-01-24T15:35:06.180 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-01-24 15:27:22.695582363 +0000 2024-01-24T15:35:06.181 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-24T15:35:06.313 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-01-24T15:35:06.313 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-01-24T15:35:06.313 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000300885 s, 1.7 MB/s 2024-01-24T15:35:06.316 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-24T15:35:06.360 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_3 2024-01-24T15:35:06.457 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-24T15:35:06.457 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T15:35:06.458 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 460 Links: 1 2024-01-24T15:35:06.458 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T15:35:06.458 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2024-01-24T15:35:06.458 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-01-24 15:35:06.177175798 +0000 2024-01-24T15:35:06.458 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-01-24 15:27:23.204575510 +0000 2024-01-24T15:35:06.458 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-01-24 15:27:23.204575510 +0000 2024-01-24T15:35:06.458 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-01-24 15:27:23.178575860 +0000 2024-01-24T15:35:06.458 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-24T15:35:06.602 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-01-24T15:35:06.602 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-01-24T15:35:06.602 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000270266 s, 1.9 MB/s 2024-01-24T15:35:06.605 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-24T15:35:06.652 DEBUG:teuthology.orchestra.run.smithi204:> stat /dev/vg_nvme/lv_4 2024-01-24T15:35:06.736 INFO:teuthology.orchestra.run.smithi204.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-24T15:35:06.737 INFO:teuthology.orchestra.run.smithi204.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-24T15:35:06.737 INFO:teuthology.orchestra.run.smithi204.stdout:Device: 5h/5d Inode: 466 Links: 1 2024-01-24T15:35:06.737 INFO:teuthology.orchestra.run.smithi204.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-24T15:35:06.737 INFO:teuthology.orchestra.run.smithi204.stdout:Context: system_u:object_r:device_t:s0 2024-01-24T15:35:06.737 INFO:teuthology.orchestra.run.smithi204.stdout:Access: 2024-01-24 15:35:06.476171700 +0000 2024-01-24T15:35:06.737 INFO:teuthology.orchestra.run.smithi204.stdout:Modify: 2024-01-24 15:27:23.661569357 +0000 2024-01-24T15:35:06.737 INFO:teuthology.orchestra.run.smithi204.stdout:Change: 2024-01-24 15:27:23.661569357 +0000 2024-01-24T15:35:06.737 INFO:teuthology.orchestra.run.smithi204.stdout: Birth: 2024-01-24 15:27:23.637569680 +0000 2024-01-24T15:35:06.737 DEBUG:teuthology.orchestra.run.smithi204:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-24T15:35:06.845 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records in 2024-01-24T15:35:06.845 INFO:teuthology.orchestra.run.smithi204.stderr:1+0 records out 2024-01-24T15:35:06.845 INFO:teuthology.orchestra.run.smithi204.stderr:512 bytes copied, 0.000308365 s, 1.7 MB/s 2024-01-24T15:35:06.845 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:06 smithi204 systemd[1]: Starting Ceph mgr.z for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:35:06.849 DEBUG:teuthology.orchestra.run.smithi204:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-24T15:35:06.892 INFO:tasks.cephadm:Deploying osd.0 on smithi005 with /dev/vg_nvme/lv_4... 2024-01-24T15:35:06.892 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-01-24T15:35:07.255 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.a/config 2024-01-24T15:35:07.474 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:07 smithi204 bash[41655]: 211e1dfeb5cbd0d7cb88b342a4777886bd102dff1ae83e58f190473b1ce87e6a 2024-01-24T15:35:07.475 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:07 smithi204 ceph-mgr[41726]: -- 172.21.15.204:0/2648133650 <== mon.1 v2:172.21.15.204:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c53dd411e0 con 0x55c53dd18c00 2024-01-24T15:35:07.475 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:07 smithi204 systemd[1]: Started Ceph mgr.z for bede0bb6-bacd-11ee-95b1-87774f69a715. 2024-01-24T15:35:07.975 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:07 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:07.676+0000 7fb1760e2200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-24T15:35:07.975 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:07 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:07.794+0000 7fb1760e2200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-24T15:35:07.975 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:07 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:07.908+0000 7fb1760e2200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-24T15:35:08.285 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:08 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:08.018+0000 7fb1760e2200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-24T15:35:08.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:08 smithi005 ceph-mon[35346]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:08.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:08 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:08.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:08 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:08.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:08 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:08.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:08 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-24T15:35:08.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:08 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-01-24T15:35:08.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:08 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-24T15:35:08.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:08 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:08.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:08 smithi005 ceph-mon[35346]: Deploying daemon mgr.y on smithi160 2024-01-24T15:35:08.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:08 smithi160 ceph-mon[38982]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:08.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:08 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:08.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:08 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:08.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:08 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:08.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:08 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-24T15:35:08.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:08 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-01-24T15:35:08.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:08 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-24T15:35:08.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:08 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:08.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:08 smithi160 ceph-mon[38982]: Deploying daemon mgr.y on smithi160 2024-01-24T15:35:08.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:08 smithi204 ceph-mon[39634]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:08.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:08 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:08.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:08 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:08.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:08 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:08.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:08 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-24T15:35:08.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:08 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-01-24T15:35:08.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:08 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-24T15:35:08.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:08 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:08.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:08 smithi204 ceph-mon[39634]: Deploying daemon mgr.y on smithi160 2024-01-24T15:35:08.843 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-01-24T15:35:08.843 INFO:teuthology.orchestra.run.smithi005.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-01-24T15:35:08.843 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10+0 records in 2024-01-24T15:35:08.843 INFO:teuthology.orchestra.run.smithi005.stderr:10+0 records out 2024-01-24T15:35:08.843 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0301987 s, 347 MB/s 2024-01-24T15:35:08.843 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping successful for: 2024-01-24T15:35:09.155 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:08 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:08.860+0000 7fb1760e2200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-24T15:35:09.245 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph orch daemon add osd smithi005:vg_nvme/lv_4 2024-01-24T15:35:09.256 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:09 smithi160 systemd[1]: Starting Ceph mgr.y for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:35:09.475 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:09 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:09.153+0000 7fb1760e2200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-24T15:35:09.475 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:09 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:09.262+0000 7fb1760e2200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-24T15:35:09.475 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:09 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:09.398+0000 7fb1760e2200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-24T15:35:09.602 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.a/config 2024-01-24T15:35:09.873 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:09 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:09.592+0000 7fb1760e2200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-24T15:35:09.873 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:09 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:09.762+0000 7fb1760e2200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-24T15:35:10.007 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:09 smithi160 bash[40416]: 40d0550499913853159a63f8199d4ede239c1b344da5ead92e0ed7bf2d8043b5 2024-01-24T15:35:10.007 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:09 smithi160 systemd[1]: Started Ceph mgr.y for bede0bb6-bacd-11ee-95b1-87774f69a715. 2024-01-24T15:35:10.007 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:09 smithi160 ceph-mgr[40454]: -- 172.21.15.160:0/3343659349 <== mon.2 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bf5a8091e0 con 0x55bf5a7e0c00 2024-01-24T15:35:10.224 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:09 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:09.871+0000 7fb1760e2200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-24T15:35:10.288 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:10 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:10.031+0000 7f2836fb4200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-24T15:35:10.288 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:10 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:10.157+0000 7f2836fb4200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-24T15:35:10.288 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:10 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:10.272+0000 7f2836fb4200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-24T15:35:10.432 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:10 smithi005 ceph-mon[35346]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:10.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:10 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:10.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:10 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:10.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:10 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:10.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:10 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:10.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:10 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:35:10.725 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:10 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:10.381+0000 7fb1760e2200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-24T15:35:10.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:10 smithi204 ceph-mon[39634]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:10.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:10 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:10.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:10 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:10.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:10 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:10.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:10 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:10.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:10 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:35:10.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.730+0000 7f56b3600700 1 -- 172.21.15.5:0/3519866904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56ac102970 msgr2=0x7f56ac109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:35:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.730+0000 7f56b3600700 1 --2- 172.21.15.5:0/3519866904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56ac102970 0x7f56ac109220 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f56a400b0d0 tx=0x7f56a400b3e0 comp rx=0 tx=0).stop 2024-01-24T15:35:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.730+0000 7f56b3600700 1 -- 172.21.15.5:0/3519866904 shutdown_connections 2024-01-24T15:35:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.730+0000 7f56b3600700 1 --2- 172.21.15.5:0/3519866904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56ac102970 0x7f56ac109220 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.730+0000 7f56b3600700 1 --2- 172.21.15.5:0/3519866904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56ac100dd0 0x7f56ac1011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.730+0000 7f56b3600700 1 --2- 172.21.15.5:0/3519866904 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56ac101fd0 0x7f56ac102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.730+0000 7f56b3600700 1 -- 172.21.15.5:0/3519866904 >> 172.21.15.5:0/3519866904 conn(0x7f56ac0fc330 msgr2=0x7f56ac0fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:35:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.730+0000 7f56b3600700 1 -- 172.21.15.5:0/3519866904 shutdown_connections 2024-01-24T15:35:10.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.730+0000 7f56b3600700 1 -- 172.21.15.5:0/3519866904 wait complete. 2024-01-24T15:35:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.731+0000 7f56b3600700 1 Processor -- start 2024-01-24T15:35:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.731+0000 7f56b3600700 1 -- start start 2024-01-24T15:35:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.732+0000 7f56b3600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56ac100dd0 0x7f56ac198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:35:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.732+0000 7f56b3600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56ac101fd0 0x7f56ac1991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:35:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.732+0000 7f56b3600700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56ac102970 0x7f56ac1a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:35:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.732+0000 7f56b3600700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac1a07c0 con 0x7f56ac101fd0 2024-01-24T15:35:10.733 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.732+0000 7f56b3600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac1a0900 con 0x7f56ac100dd0 2024-01-24T15:35:10.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.732+0000 7f56b3600700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac1a0ac0 con 0x7f56ac102970 2024-01-24T15:35:10.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.732+0000 7f56abe00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56ac101fd0 0x7f56ac1991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:35:10.734 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.732+0000 7f56b0c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56ac100dd0 0x7f56ac198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:35:10.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.732+0000 7f56b0c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56ac100dd0 0x7f56ac198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.5:49864/0 (socket says 172.21.15.5:49864) 2024-01-24T15:35:10.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.732+0000 7f56b0c00700 1 -- 172.21.15.5:0/4275358483 learned_addr learned my addr 172.21.15.5:0/4275358483 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:35:10.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.732+0000 7f56b1600700 1 --2- 172.21.15.5:0/4275358483 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56ac102970 0x7f56ac1a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:35:10.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.733+0000 7f56b0c00700 1 -- 172.21.15.5:0/4275358483 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56ac102970 msgr2=0x7f56ac1a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:35:10.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.733+0000 7f56b0c00700 1 --2- 172.21.15.5:0/4275358483 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56ac102970 0x7f56ac1a01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:10.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.733+0000 7f56b0c00700 1 -- 172.21.15.5:0/4275358483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56ac101fd0 msgr2=0x7f56ac1991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:35:10.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.733+0000 7f56b0c00700 1 --2- 172.21.15.5:0/4275358483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56ac101fd0 0x7f56ac1991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:10.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.733+0000 7f56b0c00700 1 -- 172.21.15.5:0/4275358483 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a4009d00 con 0x7f56ac100dd0 2024-01-24T15:35:10.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.733+0000 7f56b0c00700 1 --2- 172.21.15.5:0/4275358483 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56ac100dd0 0x7f56ac198c70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f569c00c990 tx=0x7f569c00cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:35:10.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.733+0000 7f56a9600700 1 -- 172.21.15.5:0/4275358483 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c007940 con 0x7f56ac100dd0 2024-01-24T15:35:10.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.733+0000 7f56b3600700 1 -- 172.21.15.5:0/4275358483 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ac1a0da0 con 0x7f56ac100dd0 2024-01-24T15:35:10.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.733+0000 7f56a9600700 1 -- 172.21.15.5:0/4275358483 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f569c00f450 con 0x7f56ac100dd0 2024-01-24T15:35:10.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.733+0000 7f56a9600700 1 -- 172.21.15.5:0/4275358483 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c018660 con 0x7f56ac100dd0 2024-01-24T15:35:10.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.733+0000 7f56b3600700 1 -- 172.21.15.5:0/4275358483 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ac1a11e0 con 0x7f56ac100dd0 2024-01-24T15:35:10.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.735+0000 7f56b3600700 1 -- 172.21.15.5:0/4275358483 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56ac10c490 con 0x7f56ac100dd0 2024-01-24T15:35:10.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.735+0000 7f56a9600700 1 -- 172.21.15.5:0/4275358483 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 13) v1 ==== 45323+0+0 (secure 0 0 0) 0x7f569c007aa0 con 0x7f56ac100dd0 2024-01-24T15:35:10.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.735+0000 7f56a9600700 1 --2- 172.21.15.5:0/4275358483 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f568c0385d0 0x7f568c03aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:35:10.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.735+0000 7f56a9600700 1 -- 172.21.15.5:0/4275358483 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f569c04acf0 con 0x7f56ac100dd0 2024-01-24T15:35:10.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.735+0000 7f56abe00700 1 --2- 172.21.15.5:0/4275358483 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f568c0385d0 0x7f568c03aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:35:10.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.736+0000 7f56abe00700 1 --2- 172.21.15.5:0/4275358483 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f568c0385d0 0x7f568c03aa90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5694009be0 tx=0x7f5694009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:35:10.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.746+0000 7f56a9600700 1 -- 172.21.15.5:0/4275358483 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f569c007d50 con 0x7f56ac100dd0 2024-01-24T15:35:10.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:10 smithi160 ceph-mon[38982]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:10.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:10 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:10.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:10 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:10.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:10 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:10.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:10 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:10.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:10 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:35:10.757 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:10 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:10.395+0000 7f2836fb4200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-24T15:35:10.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:10.964+0000 7f56b3600700 1 -- 172.21.15.5:0/4275358483 --> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f56ac108f80 con 0x7f568c0385d0 2024-01-24T15:35:11.122 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:10 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:10.753+0000 7fb1760e2200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-24T15:35:11.475 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:11 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:11.120+0000 7fb1760e2200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-24T15:35:11.475 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:11 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:11.252+0000 7fb1760e2200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-24T15:35:11.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:11 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:35:11.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:11 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:35:11.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:11 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:11.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:11 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:11.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:11 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:11.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:11 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:11.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:11 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:11.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:11 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:11.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:11 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:35:11.476 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:11 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:11.544 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:35:11.544 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:35:11.544 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:11.544 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:11.544 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:11.544 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:11.544 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:11.544 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:11.544 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:35:11.544 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:11.599 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:11 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:11.298+0000 7f2836fb4200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-24T15:35:11.600 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:11 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:11.598+0000 7f2836fb4200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-24T15:35:11.600 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:11 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:35:11.600 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:11 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:35:11.600 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:11 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:11.600 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:11 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:11.600 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:11 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:11.600 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:11 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:11.600 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:11 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:11.600 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:11 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:11.600 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:11 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:35:11.600 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:11 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:12.006 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:11 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:11.707+0000 7f2836fb4200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-24T15:35:12.007 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:11 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:11.844+0000 7f2836fb4200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-24T15:35:12.293 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:12 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:12.038+0000 7f2836fb4200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-24T15:35:12.293 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:12 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:12.204+0000 7f2836fb4200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-24T15:35:12.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:12 smithi005 ceph-mon[35346]: from='client.24113 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:35:12.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:12 smithi005 ceph-mon[35346]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:12.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:12 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-24T15:35:12.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:12 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-24T15:35:12.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:12 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:12.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:12 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:12.474 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:12 smithi204 ceph-mon[39634]: from='client.24113 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:35:12.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:12 smithi204 ceph-mon[39634]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:12.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:12 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-24T15:35:12.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:12 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-24T15:35:12.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:12 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:12.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:12 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:12.475 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:12 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:12.219+0000 7fb1760e2200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-24T15:35:12.475 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:12 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:12.342+0000 7fb1760e2200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-24T15:35:12.756 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:12 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:12.315+0000 7f2836fb4200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-24T15:35:12.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:12 smithi160 ceph-mon[38982]: from='client.24113 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:35:12.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:12 smithi160 ceph-mon[38982]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:12.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:12 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-24T15:35:12.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:12 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-24T15:35:12.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:12 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:12.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:12 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:12.974 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:12 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:12.534+0000 7fb1760e2200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-24T15:35:13.133 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:12 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:12.780+0000 7f2836fb4200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-24T15:35:13.400 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:13 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:13.131+0000 7f2836fb4200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-24T15:35:13.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:13 smithi005 ceph-mon[35346]: Reconfiguring mgr.x (unknown last config time)... 2024-01-24T15:35:13.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:13 smithi005 ceph-mon[35346]: Reconfiguring daemon mgr.x on smithi005 2024-01-24T15:35:13.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:13 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:13.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:13 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:13.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:13 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:35:13.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:13 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:13.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:13 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:35:13.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:13 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:13.725 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:13 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:13.348+0000 7fb1760e2200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-24T15:35:13.725 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:13 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:13.583+0000 7fb1760e2200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-24T15:35:13.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:13 smithi204 ceph-mon[39634]: Reconfiguring mgr.x (unknown last config time)... 2024-01-24T15:35:13.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:13 smithi204 ceph-mon[39634]: Reconfiguring daemon mgr.x on smithi005 2024-01-24T15:35:13.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:13 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:13.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:13 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:13.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:13 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:35:13.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:13 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:13.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:13 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:35:13.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:13 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:13.756 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:13 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:13.482+0000 7f2836fb4200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-24T15:35:13.756 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:13 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:13.603+0000 7f2836fb4200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-24T15:35:13.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:13 smithi160 ceph-mon[38982]: Reconfiguring mgr.x (unknown last config time)... 2024-01-24T15:35:13.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:13 smithi160 ceph-mon[38982]: Reconfiguring daemon mgr.x on smithi005 2024-01-24T15:35:13.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:13 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:13.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:13 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:13.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:13 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:35:13.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:13 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:13.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:13 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:35:13.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:13 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:14.225 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:13 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:13.833+0000 7fb1760e2200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-24T15:35:14.679 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:14 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:14.555+0000 7f2836fb4200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-24T15:35:14.679 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:14 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:14.678+0000 7f2836fb4200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-24T15:35:14.680 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:14 smithi160 ceph-mon[38982]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:14.680 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:14 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/2848462802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "caab3496-5d11-4c8e-bd4f-ca7cdb6924a8"}]: dispatch 2024-01-24T15:35:14.680 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:14 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/2848462802' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "caab3496-5d11-4c8e-bd4f-ca7cdb6924a8"}]': finished 2024-01-24T15:35:14.680 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:14 smithi160 ceph-mon[38982]: osdmap e5: 1 total, 0 up, 1 in 2024-01-24T15:35:14.680 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:14 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-24T15:35:14.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:14 smithi005 ceph-mon[35346]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:14.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:14 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/2848462802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "caab3496-5d11-4c8e-bd4f-ca7cdb6924a8"}]: dispatch 2024-01-24T15:35:14.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:14 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/2848462802' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "caab3496-5d11-4c8e-bd4f-ca7cdb6924a8"}]': finished 2024-01-24T15:35:14.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:14 smithi005 ceph-mon[35346]: osdmap e5: 1 total, 0 up, 1 in 2024-01-24T15:35:14.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:14 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-24T15:35:14.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:14 smithi204 ceph-mon[39634]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:14.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:14 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/2848462802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "caab3496-5d11-4c8e-bd4f-ca7cdb6924a8"}]: dispatch 2024-01-24T15:35:14.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:14 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/2848462802' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "caab3496-5d11-4c8e-bd4f-ca7cdb6924a8"}]': finished 2024-01-24T15:35:14.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:14 smithi204 ceph-mon[39634]: osdmap e5: 1 total, 0 up, 1 in 2024-01-24T15:35:14.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:14 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-24T15:35:15.006 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:14 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:14.864+0000 7f2836fb4200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-24T15:35:15.225 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:14 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:14.964+0000 7fb1760e2200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-24T15:35:15.676 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:15 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/593448241' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:35:15.677 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:15 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:15.313+0000 7fb1760e2200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-24T15:35:15.677 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:15 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:15.430+0000 7fb1760e2200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-24T15:35:15.682 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:15 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/593448241' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:35:15.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:15 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/593448241' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:35:15.975 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:35:15 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z[41703]: 2024-01-24T15:35:15.675+0000 7fb1760e2200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-24T15:35:16.006 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:15 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:15.680+0000 7f2836fb4200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-24T15:35:16.006 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:15 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:15.914+0000 7f2836fb4200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-24T15:35:16.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:16.416+0000 7f56a9600700 1 -- 172.21.15.5:0/4275358483 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mgrmap(e 14) v1 ==== 90168+0+0 (secure 0 0 0) 0x7f569c018ce0 con 0x7f56ac100dd0 2024-01-24T15:35:16.506 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:16 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:16.160+0000 7f2836fb4200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-24T15:35:16.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:16 smithi160 ceph-mon[38982]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:16.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:16 smithi160 ceph-mon[38982]: Standby manager daemon z started 2024-01-24T15:35:16.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:16 smithi160 ceph-mon[38982]: from='mgr.? 172.21.15.204:0/1570724417' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-01-24T15:35:16.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:16 smithi160 ceph-mon[38982]: from='mgr.? 172.21.15.204:0/1570724417' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-24T15:35:16.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:16 smithi160 ceph-mon[38982]: from='mgr.? 172.21.15.204:0/1570724417' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-01-24T15:35:16.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:16 smithi160 ceph-mon[38982]: from='mgr.? 172.21.15.204:0/1570724417' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-24T15:35:16.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:16 smithi005 ceph-mon[35346]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:16.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:16 smithi005 ceph-mon[35346]: Standby manager daemon z started 2024-01-24T15:35:16.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:16 smithi005 ceph-mon[35346]: from='mgr.? 172.21.15.204:0/1570724417' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-01-24T15:35:16.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:16 smithi005 ceph-mon[35346]: from='mgr.? 172.21.15.204:0/1570724417' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-24T15:35:16.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:16 smithi005 ceph-mon[35346]: from='mgr.? 172.21.15.204:0/1570724417' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-01-24T15:35:16.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:16 smithi005 ceph-mon[35346]: from='mgr.? 172.21.15.204:0/1570724417' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-24T15:35:16.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:16 smithi204 ceph-mon[39634]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:16.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:16 smithi204 ceph-mon[39634]: Standby manager daemon z started 2024-01-24T15:35:16.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:16 smithi204 ceph-mon[39634]: from='mgr.? 172.21.15.204:0/1570724417' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-01-24T15:35:16.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:16 smithi204 ceph-mon[39634]: from='mgr.? 172.21.15.204:0/1570724417' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-24T15:35:16.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:16 smithi204 ceph-mon[39634]: from='mgr.? 172.21.15.204:0/1570724417' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-01-24T15:35:16.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:16 smithi204 ceph-mon[39634]: from='mgr.? 172.21.15.204:0/1570724417' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-24T15:35:17.631 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:17 smithi160 ceph-mon[38982]: mgrmap e14: x(active, since 69s), standbys: z 2024-01-24T15:35:17.631 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:17 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-01-24T15:35:17.631 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:17 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:17.279+0000 7f2836fb4200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-24T15:35:17.631 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:17 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:17.628+0000 7f2836fb4200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-24T15:35:17.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:17 smithi005 ceph-mon[35346]: mgrmap e14: x(active, since 69s), standbys: z 2024-01-24T15:35:17.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:17 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-01-24T15:35:17.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:17 smithi204 ceph-mon[39634]: mgrmap e14: x(active, since 69s), standbys: z 2024-01-24T15:35:17.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:17 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-01-24T15:35:17.992 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:17 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:17.741+0000 7f2836fb4200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-24T15:35:17.992 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:35:17 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y[40431]: 2024-01-24T15:35:17.990+0000 7f2836fb4200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-24T15:35:18.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:18.430+0000 7f56a9600700 1 -- 172.21.15.5:0/4275358483 <== mon.2 v2:172.21.15.160:3300/0 8 ==== mgrmap(e 15) v1 ==== 135013+0+0 (secure 0 0 0) 0x7f569c00e3b0 con 0x7f56ac100dd0 2024-01-24T15:35:18.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:18 smithi005 ceph-mon[35346]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:18.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:18 smithi005 ceph-mon[35346]: Standby manager daemon y started 2024-01-24T15:35:18.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:18 smithi005 ceph-mon[35346]: from='mgr.? 172.21.15.160:0/3102607253' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-01-24T15:35:18.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:18 smithi005 ceph-mon[35346]: from='mgr.? 172.21.15.160:0/3102607253' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-24T15:35:18.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:18 smithi005 ceph-mon[35346]: from='mgr.? 172.21.15.160:0/3102607253' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-01-24T15:35:18.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:18 smithi005 ceph-mon[35346]: from='mgr.? 172.21.15.160:0/3102607253' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-24T15:35:18.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:18 smithi204 ceph-mon[39634]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:18.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:18 smithi204 ceph-mon[39634]: Standby manager daemon y started 2024-01-24T15:35:18.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:18 smithi204 ceph-mon[39634]: from='mgr.? 172.21.15.160:0/3102607253' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-01-24T15:35:18.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:18 smithi204 ceph-mon[39634]: from='mgr.? 172.21.15.160:0/3102607253' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-24T15:35:18.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:18 smithi204 ceph-mon[39634]: from='mgr.? 172.21.15.160:0/3102607253' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-01-24T15:35:18.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:18 smithi204 ceph-mon[39634]: from='mgr.? 172.21.15.160:0/3102607253' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-24T15:35:18.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:18 smithi160 ceph-mon[38982]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:18.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:18 smithi160 ceph-mon[38982]: Standby manager daemon y started 2024-01-24T15:35:18.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:18 smithi160 ceph-mon[38982]: from='mgr.? 172.21.15.160:0/3102607253' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-01-24T15:35:18.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:18 smithi160 ceph-mon[38982]: from='mgr.? 172.21.15.160:0/3102607253' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-24T15:35:18.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:18 smithi160 ceph-mon[38982]: from='mgr.? 172.21.15.160:0/3102607253' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-01-24T15:35:18.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:18 smithi160 ceph-mon[38982]: from='mgr.? 172.21.15.160:0/3102607253' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-24T15:35:19.669 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:19 smithi005 ceph-mon[35346]: mgrmap e15: x(active, since 71s), standbys: z, y 2024-01-24T15:35:19.670 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:19 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-24T15:35:19.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:19 smithi204 ceph-mon[39634]: mgrmap e15: x(active, since 71s), standbys: z, y 2024-01-24T15:35:19.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:19 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-24T15:35:19.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:19 smithi160 ceph-mon[38982]: mgrmap e15: x(active, since 71s), standbys: z, y 2024-01-24T15:35:19.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:19 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-24T15:35:20.573 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:20 smithi005 ceph-mon[35346]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:20.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:20 smithi204 ceph-mon[39634]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:20.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:20 smithi160 ceph-mon[38982]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:21.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:21 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-24T15:35:21.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:21 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:21.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:21 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-24T15:35:21.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:21 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:21.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:21 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-24T15:35:21.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:21 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:22.672 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:22 smithi005 ceph-mon[35346]: Deploying daemon osd.0 on smithi005 2024-01-24T15:35:22.673 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:22 smithi005 ceph-mon[35346]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:22.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:22 smithi204 ceph-mon[39634]: Deploying daemon osd.0 on smithi005 2024-01-24T15:35:22.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:22 smithi204 ceph-mon[39634]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:22.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:22 smithi160 ceph-mon[38982]: Deploying daemon osd.0 on smithi005 2024-01-24T15:35:22.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:22 smithi160 ceph-mon[38982]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:24.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:24 smithi204 ceph-mon[39634]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:24.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:24 smithi160 ceph-mon[38982]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:24.782 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:24 smithi005 ceph-mon[35346]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:26.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:26 smithi204 ceph-mon[39634]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:26.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:26 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:26.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:26 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:35:26.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:26 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:26.735 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:26 smithi005 ceph-mon[35346]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:26.735 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:26 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:26.735 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:26 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:35:26.735 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:26 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:26.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:26 smithi160 ceph-mon[38982]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:26.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:26 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:26.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:26 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:35:26.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:26 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:28.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:28 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:28.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:28 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:28.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:28 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:28.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:28 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:35:28.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:28 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:28.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:28 smithi005 ceph-mon[35346]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:28.275 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 0 on host 'smithi005' 2024-01-24T15:35:28.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:28.272+0000 7f56a9600700 1 -- 172.21.15.5:0/4275358483 <== mgr.14150 v2:172.21.15.5:6800/1971309753 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f56ac108f80 con 0x7f568c0385d0 2024-01-24T15:35:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:28.274+0000 7f56b3600700 1 -- 172.21.15.5:0/4275358483 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f568c0385d0 msgr2=0x7f568c03aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:35:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:28.274+0000 7f56b3600700 1 --2- 172.21.15.5:0/4275358483 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f568c0385d0 0x7f568c03aa90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5694009be0 tx=0x7f5694009260 comp rx=0 tx=0).stop 2024-01-24T15:35:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:28.274+0000 7f56b3600700 1 -- 172.21.15.5:0/4275358483 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56ac100dd0 msgr2=0x7f56ac198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:35:28.277 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:28.274+0000 7f56b3600700 1 --2- 172.21.15.5:0/4275358483 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56ac100dd0 0x7f56ac198c70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f569c00c990 tx=0x7f569c00cca0 comp rx=0 tx=0).stop 2024-01-24T15:35:28.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:28.274+0000 7f56b3600700 1 -- 172.21.15.5:0/4275358483 shutdown_connections 2024-01-24T15:35:28.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:28.274+0000 7f56b3600700 1 --2- 172.21.15.5:0/4275358483 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f56ac102970 0x7f56ac1a01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:28.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:28.274+0000 7f56b3600700 1 --2- 172.21.15.5:0/4275358483 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56ac100dd0 0x7f56ac198c70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:28.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:28.274+0000 7f56b3600700 1 --2- 172.21.15.5:0/4275358483 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f568c0385d0 0x7f568c03aa90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:28.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:28.274+0000 7f56b3600700 1 --2- 172.21.15.5:0/4275358483 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56ac101fd0 0x7f56ac1991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:28.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:28.274+0000 7f56b3600700 1 -- 172.21.15.5:0/4275358483 >> 172.21.15.5:0/4275358483 conn(0x7f56ac0fc330 msgr2=0x7f56ac107860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:35:28.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:28.275+0000 7f56b3600700 1 -- 172.21.15.5:0/4275358483 shutdown_connections 2024-01-24T15:35:28.278 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:35:28.275+0000 7f56b3600700 1 -- 172.21.15.5:0/4275358483 wait complete. 2024-01-24T15:35:28.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:28 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:28.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:28 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:28.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:28 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:28.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:28 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:35:28.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:28 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:28.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:28 smithi204 ceph-mon[39634]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:28.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:28 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:28.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:28 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:28.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:28 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:28.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:28 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:35:28.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:28 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:28.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:28 smithi160 ceph-mon[38982]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:28.621 DEBUG:teuthology.orchestra.run.smithi005:osd.0> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.0.service 2024-01-24T15:35:28.625 INFO:tasks.cephadm:Deploying osd.1 on smithi160 with /dev/vg_nvme/lv_4... 2024-01-24T15:35:28.626 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-01-24T15:35:28.701 INFO:journalctl@ceph.osd.0.smithi005.stdout:-- Logs begin at Wed 2024-01-24 15:16:42 UTC. -- 2024-01-24T15:35:28.982 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.b/config 2024-01-24T15:35:29.455 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:29 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:29.456 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:29 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:29.456 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:29 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:35:29.500 INFO:journalctl@ceph.osd.0.smithi005.stdout:Jan 24 15:35:29 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-0[53422]: 2024-01-24T15:35:29.492+0000 7f21255a9640 -1 osd.0 0 log_to_monitors true 2024-01-24T15:35:29.500 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:29 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:29.500 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:29 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:29.500 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:29 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:35:29.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:29 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:29.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:29 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:29.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:29 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:35:30.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:30 smithi160 ceph-mon[38982]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:30.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:30 smithi160 ceph-mon[38982]: from='osd.0 [v2:172.21.15.5:6802/3395335330,v1:172.21.15.5:6803/3395335330]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-24T15:35:30.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:30 smithi160 ceph-mon[38982]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-24T15:35:30.527 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-01-24T15:35:30.527 INFO:teuthology.orchestra.run.smithi160.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-01-24T15:35:30.527 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10+0 records in 2024-01-24T15:35:30.527 INFO:teuthology.orchestra.run.smithi160.stderr:10+0 records out 2024-01-24T15:35:30.527 INFO:teuthology.orchestra.run.smithi160.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0301734 s, 348 MB/s 2024-01-24T15:35:30.527 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping successful for: 2024-01-24T15:35:30.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:30 smithi005 ceph-mon[35346]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:30.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:30 smithi005 ceph-mon[35346]: from='osd.0 [v2:172.21.15.5:6802/3395335330,v1:172.21.15.5:6803/3395335330]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-24T15:35:30.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:30 smithi005 ceph-mon[35346]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-24T15:35:30.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:30 smithi204 ceph-mon[39634]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:30.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:30 smithi204 ceph-mon[39634]: from='osd.0 [v2:172.21.15.5:6802/3395335330,v1:172.21.15.5:6803/3395335330]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-24T15:35:30.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:30 smithi204 ceph-mon[39634]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-24T15:35:30.840 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph orch daemon add osd smithi160:vg_nvme/lv_4 2024-01-24T15:35:31.186 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.b/config 2024-01-24T15:35:31.433 INFO:journalctl@ceph.osd.0.smithi005.stdout:Jan 24 15:35:31 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-0[53422]: 2024-01-24T15:35:31.270+0000 7f2119200700 -1 osd.0 0 waiting for initial osdmap 2024-01-24T15:35:31.433 INFO:journalctl@ceph.osd.0.smithi005.stdout:Jan 24 15:35:31 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-0[53422]: 2024-01-24T15:35:31.274+0000 7f2110e00700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T15:35:31.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:31 smithi005 ceph-mon[35346]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-01-24T15:35:31.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:31 smithi005 ceph-mon[35346]: osdmap e6: 1 total, 0 up, 1 in 2024-01-24T15:35:31.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:31 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-24T15:35:31.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:31 smithi005 ceph-mon[35346]: from='osd.0 [v2:172.21.15.5:6802/3395335330,v1:172.21.15.5:6803/3395335330]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-01-24T15:35:31.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:31 smithi005 ceph-mon[35346]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-01-24T15:35:31.646 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:31 smithi160 ceph-mon[38982]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-01-24T15:35:31.674 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:31 smithi160 ceph-mon[38982]: osdmap e6: 1 total, 0 up, 1 in 2024-01-24T15:35:31.674 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:31 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-24T15:35:31.674 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:31 smithi160 ceph-mon[38982]: from='osd.0 [v2:172.21.15.5:6802/3395335330,v1:172.21.15.5:6803/3395335330]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-01-24T15:35:31.674 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:31 smithi160 ceph-mon[38982]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-01-24T15:35:31.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:31 smithi204 ceph-mon[39634]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-01-24T15:35:31.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:31 smithi204 ceph-mon[39634]: osdmap e6: 1 total, 0 up, 1 in 2024-01-24T15:35:31.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:31 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-24T15:35:31.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:31 smithi204 ceph-mon[39634]: from='osd.0 [v2:172.21.15.5:6802/3395335330,v1:172.21.15.5:6803/3395335330]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-01-24T15:35:31.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:31 smithi204 ceph-mon[39634]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-01-24T15:35:32.263 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.260+0000 7f59c5400700 1 -- 172.21.15.160:0/1075568617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59c0106b80 msgr2=0x7f59c0108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:35:32.263 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.260+0000 7f59c5400700 1 --2- 172.21.15.160:0/1075568617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59c0106b80 0x7f59c0108f70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f59b800b0a0 tx=0x7f59b800b3b0 comp rx=0 tx=0).stop 2024-01-24T15:35:32.263 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.260+0000 7f59c5400700 1 -- 172.21.15.160:0/1075568617 shutdown_connections 2024-01-24T15:35:32.263 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.260+0000 7f59c5400700 1 --2- 172.21.15.160:0/1075568617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59c0106b80 0x7f59c0108f70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:32.264 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.260+0000 7f59c5400700 1 --2- 172.21.15.160:0/1075568617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59c0101920 0x7f59c0103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:32.264 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.260+0000 7f59c5400700 1 --2- 172.21.15.160:0/1075568617 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59c0104250 0x7f59c0106640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:32.264 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.260+0000 7f59c5400700 1 -- 172.21.15.160:0/1075568617 >> 172.21.15.160:0/1075568617 conn(0x7f59c00fb250 msgr2=0x7f59c00fd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:35:32.264 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.260+0000 7f59c5400700 1 -- 172.21.15.160:0/1075568617 shutdown_connections 2024-01-24T15:35:32.264 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.260+0000 7f59c5400700 1 -- 172.21.15.160:0/1075568617 wait complete. 2024-01-24T15:35:32.266 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.261+0000 7f59c5400700 1 Processor -- start 2024-01-24T15:35:32.266 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.262+0000 7f59c5400700 1 -- start start 2024-01-24T15:35:32.266 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.262+0000 7f59c5400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59c0101920 0x7f59c0198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:35:32.266 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.262+0000 7f59c5400700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59c0104250 0x7f59c01991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:35:32.266 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.262+0000 7f59c5400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59c0106b80 0x7f59c01a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:35:32.266 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.262+0000 7f59c5400700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c01a0800 con 0x7f59c0101920 2024-01-24T15:35:32.266 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.262+0000 7f59c5400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c01a0940 con 0x7f59c0106b80 2024-01-24T15:35:32.266 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.262+0000 7f59c5400700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c01a0b00 con 0x7f59c0104250 2024-01-24T15:35:32.266 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.262+0000 7f59bf200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59c0106b80 0x7f59c01a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:35:32.266 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.262+0000 7f59bf200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59c0106b80 0x7f59c01a0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:40292/0 (socket says 172.21.15.160:40292) 2024-01-24T15:35:32.266 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.262+0000 7f59bf200700 1 -- 172.21.15.160:0/2722099142 learned_addr learned my addr 172.21.15.160:0/2722099142 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-01-24T15:35:32.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.262+0000 7f59be800700 1 --2- 172.21.15.160:0/2722099142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59c0101920 0x7f59c0198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:35:32.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.263+0000 7f59bde00700 1 --2- 172.21.15.160:0/2722099142 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59c0104250 0x7f59c01991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:35:32.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.263+0000 7f59bf200700 1 -- 172.21.15.160:0/2722099142 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59c0104250 msgr2=0x7f59c01991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:35:32.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.263+0000 7f59bf200700 1 --2- 172.21.15.160:0/2722099142 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59c0104250 0x7f59c01991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:32.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.263+0000 7f59bf200700 1 -- 172.21.15.160:0/2722099142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59c0101920 msgr2=0x7f59c0198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:35:32.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.263+0000 7f59bf200700 1 --2- 172.21.15.160:0/2722099142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59c0101920 0x7f59c0198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:32.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.263+0000 7f59bf200700 1 -- 172.21.15.160:0/2722099142 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b8009d00 con 0x7f59c0106b80 2024-01-24T15:35:32.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.263+0000 7f59bf200700 1 --2- 172.21.15.160:0/2722099142 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59c0106b80 0x7f59c01a0230 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f59b800b780 tx=0x7f59b80078e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:35:32.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.263+0000 7f59b7400700 1 -- 172.21.15.160:0/2722099142 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b800e040 con 0x7f59c0106b80 2024-01-24T15:35:32.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.263+0000 7f59b7400700 1 -- 172.21.15.160:0/2722099142 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f59b8004c50 con 0x7f59c0106b80 2024-01-24T15:35:32.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.263+0000 7f59c5400700 1 -- 172.21.15.160:0/2722099142 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c01a0d80 con 0x7f59c0106b80 2024-01-24T15:35:32.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.263+0000 7f59b7400700 1 -- 172.21.15.160:0/2722099142 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b80052a0 con 0x7f59c0106b80 2024-01-24T15:35:32.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.263+0000 7f59c5400700 1 -- 172.21.15.160:0/2722099142 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c01a11a0 con 0x7f59c0106b80 2024-01-24T15:35:32.268 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.265+0000 7f59c5400700 1 -- 172.21.15.160:0/2722099142 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c0108700 con 0x7f59c0106b80 2024-01-24T15:35:32.269 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.266+0000 7f59b7400700 1 -- 172.21.15.160:0/2722099142 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 15) v1 ==== 135013+0+0 (secure 0 0 0) 0x7f59b8005400 con 0x7f59c0106b80 2024-01-24T15:35:32.271 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.268+0000 7f59b7400700 1 --2- 172.21.15.160:0/2722099142 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f59a00a0490 0x7f59a00a2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:35:32.271 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.269+0000 7f59b7400700 1 -- 172.21.15.160:0/2722099142 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1487+0+0 (secure 0 0 0) 0x7f59b80cb3d0 con 0x7f59c0106b80 2024-01-24T15:35:32.271 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.269+0000 7f59be800700 1 --2- 172.21.15.160:0/2722099142 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f59a00a0490 0x7f59a00a2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:35:32.272 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.269+0000 7f59be800700 1 --2- 172.21.15.160:0/2722099142 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f59a00a0490 0x7f59a00a2950 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f59c0199b60 tx=0x7f59b0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:35:32.277 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.275+0000 7f59b7400700 1 -- 172.21.15.160:0/2722099142 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f59b8096af0 con 0x7f59c0106b80 2024-01-24T15:35:32.483 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:32.481+0000 7f59c5400700 1 -- 172.21.15.160:0/2722099142 --> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f59c0061180 con 0x7f59a00a0490 2024-01-24T15:35:32.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:32 smithi160 ceph-mon[38982]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:32.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:32 smithi160 ceph-mon[38982]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-01-24T15:35:32.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:32 smithi160 ceph-mon[38982]: osdmap e7: 1 total, 0 up, 1 in 2024-01-24T15:35:32.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-24T15:35:32.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-24T15:35:32.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:32 smithi160 ceph-mon[38982]: Detected new or changed devices on smithi005 2024-01-24T15:35:32.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:32.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:32.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:35:32.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:32 smithi160 ceph-mon[38982]: Adjusting osd_memory_target on smithi005 to 17276M 2024-01-24T15:35:32.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:32.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:32.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:35:32.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:32.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:32 smithi005 ceph-mon[35346]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:32.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:32 smithi005 ceph-mon[35346]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-01-24T15:35:32.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:32 smithi005 ceph-mon[35346]: osdmap e7: 1 total, 0 up, 1 in 2024-01-24T15:35:32.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-24T15:35:32.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-24T15:35:32.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:32 smithi005 ceph-mon[35346]: Detected new or changed devices on smithi005 2024-01-24T15:35:32.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:32.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:32.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:35:32.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:32 smithi005 ceph-mon[35346]: Adjusting osd_memory_target on smithi005 to 17276M 2024-01-24T15:35:32.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:32.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:32.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:35:32.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:32 smithi204 ceph-mon[39634]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:32 smithi204 ceph-mon[39634]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-01-24T15:35:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:32 smithi204 ceph-mon[39634]: osdmap e7: 1 total, 0 up, 1 in 2024-01-24T15:35:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-24T15:35:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-24T15:35:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:32 smithi204 ceph-mon[39634]: Detected new or changed devices on smithi005 2024-01-24T15:35:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:35:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:32 smithi204 ceph-mon[39634]: Adjusting osd_memory_target on smithi005 to 17276M 2024-01-24T15:35:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:35:32.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:33.413 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:33 smithi160 ceph-mon[38982]: purged_snaps scrub starts 2024-01-24T15:35:33.413 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:33 smithi160 ceph-mon[38982]: purged_snaps scrub ok 2024-01-24T15:35:33.414 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:33 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-24T15:35:33.414 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:33 smithi160 ceph-mon[38982]: osd.0 [v2:172.21.15.5:6802/3395335330,v1:172.21.15.5:6803/3395335330] boot 2024-01-24T15:35:33.414 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:33 smithi160 ceph-mon[38982]: osdmap e8: 1 total, 1 up, 1 in 2024-01-24T15:35:33.414 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:33 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-24T15:35:33.414 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:33 smithi160 ceph-mon[38982]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:35:33.414 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:33 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:35:33.414 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:33 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:35:33.414 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:33 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:33.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:33 smithi005 ceph-mon[35346]: purged_snaps scrub starts 2024-01-24T15:35:33.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:33 smithi005 ceph-mon[35346]: purged_snaps scrub ok 2024-01-24T15:35:33.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:33 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-24T15:35:33.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:33 smithi005 ceph-mon[35346]: osd.0 [v2:172.21.15.5:6802/3395335330,v1:172.21.15.5:6803/3395335330] boot 2024-01-24T15:35:33.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:33 smithi005 ceph-mon[35346]: osdmap e8: 1 total, 1 up, 1 in 2024-01-24T15:35:33.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:33 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-24T15:35:33.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:33 smithi005 ceph-mon[35346]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:35:33.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:33 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:35:33.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:33 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:35:33.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:33 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:33.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:33 smithi204 ceph-mon[39634]: purged_snaps scrub starts 2024-01-24T15:35:33.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:33 smithi204 ceph-mon[39634]: purged_snaps scrub ok 2024-01-24T15:35:33.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:33 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-24T15:35:33.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:33 smithi204 ceph-mon[39634]: osd.0 [v2:172.21.15.5:6802/3395335330,v1:172.21.15.5:6803/3395335330] boot 2024-01-24T15:35:33.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:33 smithi204 ceph-mon[39634]: osdmap e8: 1 total, 1 up, 1 in 2024-01-24T15:35:33.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:33 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-24T15:35:33.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:33 smithi204 ceph-mon[39634]: from='client.24137 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:35:33.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:33 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:35:33.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:33 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:35:33.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:33 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:34.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:34 smithi005 ceph-mon[35346]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:34.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:34 smithi005 ceph-mon[35346]: osdmap e9: 1 total, 1 up, 1 in 2024-01-24T15:35:34.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:34 smithi204 ceph-mon[39634]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:34.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:34 smithi204 ceph-mon[39634]: osdmap e9: 1 total, 1 up, 1 in 2024-01-24T15:35:34.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:34 smithi160 ceph-mon[38982]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-24T15:35:34.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:34 smithi160 ceph-mon[38982]: osdmap e9: 1 total, 1 up, 1 in 2024-01-24T15:35:35.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:35 smithi005 ceph-mon[35346]: from='client.? 172.21.15.160:0/2490096125' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "547ee262-816e-46ee-b4d4-8dd267abb2de"}]: dispatch 2024-01-24T15:35:35.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:35 smithi005 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "547ee262-816e-46ee-b4d4-8dd267abb2de"}]: dispatch 2024-01-24T15:35:35.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:35 smithi005 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "547ee262-816e-46ee-b4d4-8dd267abb2de"}]': finished 2024-01-24T15:35:35.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:35 smithi005 ceph-mon[35346]: osdmap e10: 2 total, 1 up, 2 in 2024-01-24T15:35:35.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:35 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-24T15:35:35.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:35 smithi204 ceph-mon[39634]: from='client.? 172.21.15.160:0/2490096125' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "547ee262-816e-46ee-b4d4-8dd267abb2de"}]: dispatch 2024-01-24T15:35:35.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:35 smithi204 ceph-mon[39634]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "547ee262-816e-46ee-b4d4-8dd267abb2de"}]: dispatch 2024-01-24T15:35:35.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:35 smithi204 ceph-mon[39634]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "547ee262-816e-46ee-b4d4-8dd267abb2de"}]': finished 2024-01-24T15:35:35.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:35 smithi204 ceph-mon[39634]: osdmap e10: 2 total, 1 up, 2 in 2024-01-24T15:35:35.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:35 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-24T15:35:35.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:35 smithi160 ceph-mon[38982]: from='client.? 172.21.15.160:0/2490096125' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "547ee262-816e-46ee-b4d4-8dd267abb2de"}]: dispatch 2024-01-24T15:35:35.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:35 smithi160 ceph-mon[38982]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "547ee262-816e-46ee-b4d4-8dd267abb2de"}]: dispatch 2024-01-24T15:35:35.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:35 smithi160 ceph-mon[38982]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "547ee262-816e-46ee-b4d4-8dd267abb2de"}]': finished 2024-01-24T15:35:35.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:35 smithi160 ceph-mon[38982]: osdmap e10: 2 total, 1 up, 2 in 2024-01-24T15:35:35.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:35 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-24T15:35:36.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:36 smithi005 ceph-mon[35346]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:36.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:36 smithi005 ceph-mon[35346]: from='client.? 172.21.15.160:0/3236255965' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:35:36.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:36 smithi204 ceph-mon[39634]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:36.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:36 smithi204 ceph-mon[39634]: from='client.? 172.21.15.160:0/3236255965' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:35:36.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:36 smithi160 ceph-mon[38982]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:36.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:36 smithi160 ceph-mon[38982]: from='client.? 172.21.15.160:0/3236255965' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:35:38.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:38 smithi005 ceph-mon[35346]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:38.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:38 smithi204 ceph-mon[39634]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:38.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:38 smithi160 ceph-mon[38982]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:40.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:40 smithi005 ceph-mon[35346]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:40.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:40 smithi204 ceph-mon[39634]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:40.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:40 smithi160 ceph-mon[38982]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:41.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:41 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-01-24T15:35:41.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:41 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:41.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:41 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-01-24T15:35:41.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:41 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:41.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:41 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-01-24T15:35:41.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:41 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:42.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:42 smithi160 ceph-mon[38982]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:42.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:42 smithi160 ceph-mon[38982]: Deploying daemon osd.1 on smithi160 2024-01-24T15:35:42.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:42 smithi005 ceph-mon[35346]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:42.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:42 smithi005 ceph-mon[35346]: Deploying daemon osd.1 on smithi160 2024-01-24T15:35:42.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:42 smithi204 ceph-mon[39634]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:42.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:42 smithi204 ceph-mon[39634]: Deploying daemon osd.1 on smithi160 2024-01-24T15:35:44.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:44 smithi204 ceph-mon[39634]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:44.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:44 smithi160 ceph-mon[38982]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:44.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:44 smithi005 ceph-mon[35346]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:46.708 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:46 smithi160 ceph-mon[38982]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:46.708 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:46 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:46.708 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:46 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:46.708 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:46 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:35:46.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:46 smithi204 ceph-mon[39634]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:46.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:46 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:46.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:46 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:46.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:46 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:35:46.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:46 smithi005 ceph-mon[35346]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:46.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:46 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:46.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:46 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:46.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:46 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:35:48.682 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:48 smithi160 ceph-mon[38982]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:48.682 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:48 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:48.682 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:48 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:48.683 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:48 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:48.683 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:48 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:35:48.683 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:48 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:48.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:48 smithi204 ceph-mon[39634]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:48.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:48 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:48.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:48 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:48.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:48 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:48.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:48 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:35:48.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:48 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:48.748 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:48.746+0000 7f59b7400700 1 -- 172.21.15.160:0/2722099142 <== mgr.14150 v2:172.21.15.5:6800/1971309753 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f59c0061180 con 0x7f59a00a0490 2024-01-24T15:35:48.749 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 1 on host 'smithi160' 2024-01-24T15:35:48.751 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:48.748+0000 7f59c5400700 1 -- 172.21.15.160:0/2722099142 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f59a00a0490 msgr2=0x7f59a00a2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:35:48.751 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:48.748+0000 7f59c5400700 1 --2- 172.21.15.160:0/2722099142 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f59a00a0490 0x7f59a00a2950 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f59c0199b60 tx=0x7f59b0009260 comp rx=0 tx=0).stop 2024-01-24T15:35:48.751 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:48.748+0000 7f59c5400700 1 -- 172.21.15.160:0/2722099142 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59c0106b80 msgr2=0x7f59c01a0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:35:48.751 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:48.748+0000 7f59c5400700 1 --2- 172.21.15.160:0/2722099142 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59c0106b80 0x7f59c01a0230 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f59b800b780 tx=0x7f59b80078e0 comp rx=0 tx=0).stop 2024-01-24T15:35:48.751 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:48.748+0000 7f59c5400700 1 -- 172.21.15.160:0/2722099142 shutdown_connections 2024-01-24T15:35:48.751 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:48.748+0000 7f59c5400700 1 --2- 172.21.15.160:0/2722099142 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59c0106b80 0x7f59c01a0230 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:48.751 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:48.748+0000 7f59c5400700 1 --2- 172.21.15.160:0/2722099142 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f59a00a0490 0x7f59a00a2950 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:48.752 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:48.748+0000 7f59c5400700 1 --2- 172.21.15.160:0/2722099142 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59c0101920 0x7f59c0198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:48.752 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:48.748+0000 7f59c5400700 1 --2- 172.21.15.160:0/2722099142 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59c0104250 0x7f59c01991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:48.752 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:48.748+0000 7f59c5400700 1 -- 172.21.15.160:0/2722099142 >> 172.21.15.160:0/2722099142 conn(0x7f59c00fb250 msgr2=0x7f59c00fffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:35:48.752 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:48.748+0000 7f59c5400700 1 -- 172.21.15.160:0/2722099142 shutdown_connections 2024-01-24T15:35:48.752 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:35:48.749+0000 7f59c5400700 1 -- 172.21.15.160:0/2722099142 wait complete. 2024-01-24T15:35:48.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:48 smithi005 ceph-mon[35346]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:48.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:48 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:48.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:48 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:48.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:48 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:48.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:48 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:35:48.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:48 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:49.091 DEBUG:teuthology.orchestra.run.smithi160:osd.1> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.1.service 2024-01-24T15:35:49.095 INFO:tasks.cephadm:Deploying osd.2 on smithi204 with /dev/vg_nvme/lv_4... 2024-01-24T15:35:49.095 DEBUG:teuthology.orchestra.run.smithi204:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-01-24T15:35:49.166 INFO:journalctl@ceph.osd.1.smithi160.stdout:-- Logs begin at Wed 2024-01-24 15:17:12 UTC. -- 2024-01-24T15:35:49.449 INFO:teuthology.orchestra.run.smithi204.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.c/config 2024-01-24T15:35:49.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:49 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:49.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:49 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:49.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:49 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:35:49.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:49 smithi204 ceph-mon[39634]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:50.000 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:49 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:50.000 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:49 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:50.000 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:49 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:35:50.000 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:49 smithi160 ceph-mon[38982]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:50.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:49 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:50.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:49 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:50.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:49 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:35:50.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:49 smithi005 ceph-mon[35346]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:50.257 INFO:journalctl@ceph.osd.1.smithi160.stdout:Jan 24 15:35:50 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-1[44024]: 2024-01-24T15:35:50.089+0000 7fd9abeb2640 -1 osd.1 0 log_to_monitors true 2024-01-24T15:35:50.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:50 smithi204 ceph-mon[39634]: from='osd.1 [v2:172.21.15.160:6800/1386884060,v1:172.21.15.160:6801/1386884060]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-24T15:35:50.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:50 smithi204 ceph-mon[39634]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-24T15:35:51.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:50 smithi160 ceph-mon[38982]: from='osd.1 [v2:172.21.15.160:6800/1386884060,v1:172.21.15.160:6801/1386884060]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-24T15:35:51.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:50 smithi160 ceph-mon[38982]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-24T15:35:51.182 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:50 smithi005 ceph-mon[35346]: from='osd.1 [v2:172.21.15.160:6800/1386884060,v1:172.21.15.160:6801/1386884060]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-24T15:35:51.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:50 smithi005 ceph-mon[35346]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-24T15:35:51.315 INFO:teuthology.orchestra.run.smithi204.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-01-24T15:35:51.315 INFO:teuthology.orchestra.run.smithi204.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-01-24T15:35:51.315 INFO:teuthology.orchestra.run.smithi204.stderr: stderr: 10+0 records in 2024-01-24T15:35:51.315 INFO:teuthology.orchestra.run.smithi204.stderr:10+0 records out 2024-01-24T15:35:51.315 INFO:teuthology.orchestra.run.smithi204.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0301922 s, 347 MB/s 2024-01-24T15:35:51.316 INFO:teuthology.orchestra.run.smithi204.stderr:--> Zapping successful for: 2024-01-24T15:35:51.814 DEBUG:teuthology.orchestra.run.smithi204:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph orch daemon add osd smithi204:vg_nvme/lv_4 2024-01-24T15:35:52.006 INFO:journalctl@ceph.osd.1.smithi160.stdout:Jan 24 15:35:51 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-1[44024]: 2024-01-24T15:35:51.737+0000 7fd99fa00700 -1 osd.1 0 waiting for initial osdmap 2024-01-24T15:35:52.007 INFO:journalctl@ceph.osd.1.smithi160.stdout:Jan 24 15:35:51 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-1[44024]: 2024-01-24T15:35:51.744+0000 7fd996200700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T15:35:52.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:51 smithi160 ceph-mon[38982]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-01-24T15:35:52.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:51 smithi160 ceph-mon[38982]: osdmap e11: 2 total, 1 up, 2 in 2024-01-24T15:35:52.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:51 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-24T15:35:52.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:51 smithi160 ceph-mon[38982]: from='osd.1 [v2:172.21.15.160:6800/1386884060,v1:172.21.15.160:6801/1386884060]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-01-24T15:35:52.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:51 smithi160 ceph-mon[38982]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-01-24T15:35:52.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:51 smithi160 ceph-mon[38982]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:52.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:51 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:52.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:51 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:52.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:51 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:35:52.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:51 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:52.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:51 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:52.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:51 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:35:52.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:51 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:52.163 INFO:teuthology.orchestra.run.smithi204.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.c/config 2024-01-24T15:35:52.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:51 smithi005 ceph-mon[35346]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-01-24T15:35:52.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:51 smithi005 ceph-mon[35346]: osdmap e11: 2 total, 1 up, 2 in 2024-01-24T15:35:52.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:51 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-24T15:35:52.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:51 smithi005 ceph-mon[35346]: from='osd.1 [v2:172.21.15.160:6800/1386884060,v1:172.21.15.160:6801/1386884060]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-01-24T15:35:52.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:51 smithi005 ceph-mon[35346]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-01-24T15:35:52.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:51 smithi005 ceph-mon[35346]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:52.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:51 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:52.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:51 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:52.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:51 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:35:52.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:51 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:52.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:51 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:52.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:51 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:35:52.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:51 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:52.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:51 smithi204 ceph-mon[39634]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-01-24T15:35:52.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:51 smithi204 ceph-mon[39634]: osdmap e11: 2 total, 1 up, 2 in 2024-01-24T15:35:52.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:51 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-24T15:35:52.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:51 smithi204 ceph-mon[39634]: from='osd.1 [v2:172.21.15.160:6800/1386884060,v1:172.21.15.160:6801/1386884060]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-01-24T15:35:52.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:51 smithi204 ceph-mon[39634]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-01-24T15:35:52.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:51 smithi204 ceph-mon[39634]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:52.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:51 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:52.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:51 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:52.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:51 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:35:52.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:51 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:52.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:51 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:52.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:51 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:35:52.227 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:51 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:35:53.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:52 smithi160 ceph-mon[38982]: Detected new or changed devices on smithi160 2024-01-24T15:35:53.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:52 smithi160 ceph-mon[38982]: Adjusting osd_memory_target on smithi160 to 17271M 2024-01-24T15:35:53.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:52 smithi160 ceph-mon[38982]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-01-24T15:35:53.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:52 smithi160 ceph-mon[38982]: osdmap e12: 2 total, 1 up, 2 in 2024-01-24T15:35:53.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:52 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-24T15:35:53.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:52 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-24T15:35:53.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:52 smithi005 ceph-mon[35346]: Detected new or changed devices on smithi160 2024-01-24T15:35:53.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:52 smithi005 ceph-mon[35346]: Adjusting osd_memory_target on smithi160 to 17271M 2024-01-24T15:35:53.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:52 smithi005 ceph-mon[35346]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-01-24T15:35:53.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:52 smithi005 ceph-mon[35346]: osdmap e12: 2 total, 1 up, 2 in 2024-01-24T15:35:53.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:52 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-24T15:35:53.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:52 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-24T15:35:53.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:52 smithi204 ceph-mon[39634]: Detected new or changed devices on smithi160 2024-01-24T15:35:53.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:52 smithi204 ceph-mon[39634]: Adjusting osd_memory_target on smithi160 to 17271M 2024-01-24T15:35:53.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:52 smithi204 ceph-mon[39634]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-01-24T15:35:53.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:52 smithi204 ceph-mon[39634]: osdmap e12: 2 total, 1 up, 2 in 2024-01-24T15:35:53.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:52 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-24T15:35:53.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:52 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-24T15:35:53.464 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.462+0000 7f309e800700 1 -- 172.21.15.204:0/2921301238 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3098101fd0 msgr2=0x7f3098102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:35:53.464 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.462+0000 7f309e800700 1 --2- 172.21.15.204:0/2921301238 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3098101fd0 0x7f3098102430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3080009990 tx=0x7f3080009ca0 comp rx=0 tx=0).stop 2024-01-24T15:35:53.464 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.462+0000 7f309e800700 1 -- 172.21.15.204:0/2921301238 shutdown_connections 2024-01-24T15:35:53.464 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.462+0000 7f309e800700 1 --2- 172.21.15.204:0/2921301238 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3098102970 0x7f3098109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:53.464 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.462+0000 7f309e800700 1 --2- 172.21.15.204:0/2921301238 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3098100dd0 0x7f30981011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:53.464 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.462+0000 7f309e800700 1 --2- 172.21.15.204:0/2921301238 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3098101fd0 0x7f3098102430 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:53.464 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.462+0000 7f309e800700 1 -- 172.21.15.204:0/2921301238 >> 172.21.15.204:0/2921301238 conn(0x7f30980fc330 msgr2=0x7f30980fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:35:53.464 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.462+0000 7f309e800700 1 -- 172.21.15.204:0/2921301238 shutdown_connections 2024-01-24T15:35:53.464 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.462+0000 7f309e800700 1 -- 172.21.15.204:0/2921301238 wait complete. 2024-01-24T15:35:53.466 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.463+0000 7f309e800700 1 Processor -- start 2024-01-24T15:35:53.467 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.463+0000 7f309e800700 1 -- start start 2024-01-24T15:35:53.467 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.463+0000 7f309e800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3098100dd0 0x7f3098074ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:35:53.467 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.463+0000 7f309e800700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3098101fd0 0x7f3098073130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:35:53.467 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.463+0000 7f309e800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3098102970 0x7f3098073670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:35:53.467 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.463+0000 7f309e800700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3098073df0 con 0x7f3098102970 2024-01-24T15:35:53.467 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.463+0000 7f309e800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3098073f60 con 0x7f3098100dd0 2024-01-24T15:35:53.467 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.463+0000 7f309e800700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30981a0a70 con 0x7f3098101fd0 2024-01-24T15:35:53.467 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.464+0000 7f3096a00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3098101fd0 0x7f3098073130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:35:53.467 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.464+0000 7f3096a00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3098101fd0 0x7f3098073130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:60764/0 (socket says 172.21.15.204:60764) 2024-01-24T15:35:53.467 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.464+0000 7f3096a00700 1 -- 172.21.15.204:0/1790270384 learned_addr learned my addr 172.21.15.204:0/1790270384 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-01-24T15:35:53.467 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.464+0000 7f3097400700 1 --2- 172.21.15.204:0/1790270384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3098100dd0 0x7f3098074ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:35:53.468 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.464+0000 7f3097e00700 1 --2- 172.21.15.204:0/1790270384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3098102970 0x7f3098073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:35:53.468 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.464+0000 7f3096a00700 1 -- 172.21.15.204:0/1790270384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3098100dd0 msgr2=0x7f3098074ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:35:53.468 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.464+0000 7f3096a00700 1 --2- 172.21.15.204:0/1790270384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3098100dd0 0x7f3098074ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:53.468 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.464+0000 7f3096a00700 1 -- 172.21.15.204:0/1790270384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3098102970 msgr2=0x7f3098073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:35:53.468 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.464+0000 7f3096a00700 1 --2- 172.21.15.204:0/1790270384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3098102970 0x7f3098073670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:35:53.468 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.464+0000 7f3096a00700 1 -- 172.21.15.204:0/1790270384 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30800095f0 con 0x7f3098101fd0 2024-01-24T15:35:53.468 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.464+0000 7f3096a00700 1 --2- 172.21.15.204:0/1790270384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3098101fd0 0x7f3098073130 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3080004360 tx=0x7f308000b9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:35:53.468 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.465+0000 7f308fe00700 1 -- 172.21.15.204:0/1790270384 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308001d070 con 0x7f3098101fd0 2024-01-24T15:35:53.468 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.465+0000 7f308fe00700 1 -- 172.21.15.204:0/1790270384 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f308000bed0 con 0x7f3098101fd0 2024-01-24T15:35:53.468 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.465+0000 7f309e800700 1 -- 172.21.15.204:0/1790270384 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30981a0cf0 con 0x7f3098101fd0 2024-01-24T15:35:53.468 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.465+0000 7f308fe00700 1 -- 172.21.15.204:0/1790270384 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3080022d80 con 0x7f3098101fd0 2024-01-24T15:35:53.468 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.465+0000 7f309e800700 1 -- 172.21.15.204:0/1790270384 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30981a1100 con 0x7f3098101fd0 2024-01-24T15:35:53.469 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.466+0000 7f309e800700 1 -- 172.21.15.204:0/1790270384 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f309810c4d0 con 0x7f3098101fd0 2024-01-24T15:35:53.469 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.468+0000 7f308fe00700 1 -- 172.21.15.204:0/1790270384 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 15) v1 ==== 135013+0+0 (secure 0 0 0) 0x7f3080022470 con 0x7f3098101fd0 2024-01-24T15:35:53.470 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.469+0000 7f308fe00700 1 --2- 172.21.15.204:0/1790270384 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f30780a0490 0x7f30780a2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:35:53.470 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.469+0000 7f308fe00700 1 -- 172.21.15.204:0/1790270384 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2309+0+0 (secure 0 0 0) 0x7f30800cb9a0 con 0x7f3098101fd0 2024-01-24T15:35:53.471 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.469+0000 7f3097400700 1 --2- 172.21.15.204:0/1790270384 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f30780a0490 0x7f30780a2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:35:53.471 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.470+0000 7f3097400700 1 --2- 172.21.15.204:0/1790270384 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f30780a0490 0x7f30780a2950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3098101e30 tx=0x7f3088009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:35:53.474 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.472+0000 7f308fe00700 1 -- 172.21.15.204:0/1790270384 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f3080096d80 con 0x7f3098101fd0 2024-01-24T15:35:53.678 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:35:53.676+0000 7f309e800700 1 -- 172.21.15.204:0/1790270384 --> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi204:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f3098061180 con 0x7f30780a0490 2024-01-24T15:35:54.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:53 smithi005 ceph-mon[35346]: purged_snaps scrub starts 2024-01-24T15:35:54.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:53 smithi005 ceph-mon[35346]: purged_snaps scrub ok 2024-01-24T15:35:54.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:53 smithi005 ceph-mon[35346]: osd.1 [v2:172.21.15.160:6800/1386884060,v1:172.21.15.160:6801/1386884060] boot 2024-01-24T15:35:54.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:53 smithi005 ceph-mon[35346]: osdmap e13: 2 total, 2 up, 2 in 2024-01-24T15:35:54.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:53 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-24T15:35:54.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:53 smithi005 ceph-mon[35346]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:54.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:53 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:35:54.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:53 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:35:54.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:53 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:54.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:53 smithi204 ceph-mon[39634]: purged_snaps scrub starts 2024-01-24T15:35:54.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:53 smithi204 ceph-mon[39634]: purged_snaps scrub ok 2024-01-24T15:35:54.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:53 smithi204 ceph-mon[39634]: osd.1 [v2:172.21.15.160:6800/1386884060,v1:172.21.15.160:6801/1386884060] boot 2024-01-24T15:35:54.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:53 smithi204 ceph-mon[39634]: osdmap e13: 2 total, 2 up, 2 in 2024-01-24T15:35:54.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:53 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-24T15:35:54.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:53 smithi204 ceph-mon[39634]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:54.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:53 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:35:54.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:53 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:35:54.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:53 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:54.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:53 smithi160 ceph-mon[38982]: purged_snaps scrub starts 2024-01-24T15:35:54.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:53 smithi160 ceph-mon[38982]: purged_snaps scrub ok 2024-01-24T15:35:54.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:53 smithi160 ceph-mon[38982]: osd.1 [v2:172.21.15.160:6800/1386884060,v1:172.21.15.160:6801/1386884060] boot 2024-01-24T15:35:54.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:53 smithi160 ceph-mon[38982]: osdmap e13: 2 total, 2 up, 2 in 2024-01-24T15:35:54.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-24T15:35:54.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:53 smithi160 ceph-mon[38982]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-01-24T15:35:54.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:35:54.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:35:54.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:35:54.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:54 smithi204 ceph-mon[39634]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi204:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:35:54.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:54 smithi204 ceph-mon[39634]: osdmap e14: 2 total, 2 up, 2 in 2024-01-24T15:35:55.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:54 smithi005 ceph-mon[35346]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi204:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:35:55.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:54 smithi005 ceph-mon[35346]: osdmap e14: 2 total, 2 up, 2 in 2024-01-24T15:35:55.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:54 smithi160 ceph-mon[38982]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi204:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:35:55.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:54 smithi160 ceph-mon[38982]: osdmap e14: 2 total, 2 up, 2 in 2024-01-24T15:35:56.182 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:55 smithi005 ceph-mon[35346]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:35:56.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:55 smithi204 ceph-mon[39634]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:35:56.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:55 smithi160 ceph-mon[38982]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:35:57.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:56 smithi005 ceph-mon[35346]: from='client.? 172.21.15.204:0/2845340588' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b07d96ff-9584-4e71-a846-e8b939918708"}]: dispatch 2024-01-24T15:35:57.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:56 smithi005 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b07d96ff-9584-4e71-a846-e8b939918708"}]: dispatch 2024-01-24T15:35:57.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:56 smithi005 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b07d96ff-9584-4e71-a846-e8b939918708"}]': finished 2024-01-24T15:35:57.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:56 smithi005 ceph-mon[35346]: osdmap e15: 3 total, 2 up, 3 in 2024-01-24T15:35:57.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:56 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-24T15:35:57.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:56 smithi204 ceph-mon[39634]: from='client.? 172.21.15.204:0/2845340588' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b07d96ff-9584-4e71-a846-e8b939918708"}]: dispatch 2024-01-24T15:35:57.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:56 smithi204 ceph-mon[39634]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b07d96ff-9584-4e71-a846-e8b939918708"}]: dispatch 2024-01-24T15:35:57.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:56 smithi204 ceph-mon[39634]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b07d96ff-9584-4e71-a846-e8b939918708"}]': finished 2024-01-24T15:35:57.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:56 smithi204 ceph-mon[39634]: osdmap e15: 3 total, 2 up, 3 in 2024-01-24T15:35:57.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:56 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-24T15:35:57.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:56 smithi160 ceph-mon[38982]: from='client.? 172.21.15.204:0/2845340588' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b07d96ff-9584-4e71-a846-e8b939918708"}]: dispatch 2024-01-24T15:35:57.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:56 smithi160 ceph-mon[38982]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b07d96ff-9584-4e71-a846-e8b939918708"}]: dispatch 2024-01-24T15:35:57.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:56 smithi160 ceph-mon[38982]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b07d96ff-9584-4e71-a846-e8b939918708"}]': finished 2024-01-24T15:35:57.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:56 smithi160 ceph-mon[38982]: osdmap e15: 3 total, 2 up, 3 in 2024-01-24T15:35:57.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:56 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-24T15:35:58.182 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:57 smithi005 ceph-mon[35346]: from='client.? 172.21.15.204:0/3205882655' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:35:58.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:35:57 smithi005 ceph-mon[35346]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:35:58.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:57 smithi204 ceph-mon[39634]: from='client.? 172.21.15.204:0/3205882655' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:35:58.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:35:57 smithi204 ceph-mon[39634]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:35:58.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:57 smithi160 ceph-mon[38982]: from='client.? 172.21.15.204:0/3205882655' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:35:58.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:35:57 smithi160 ceph-mon[38982]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:00.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:00 smithi204 ceph-mon[39634]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:00.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:00 smithi160 ceph-mon[38982]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:00.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:00 smithi005 ceph-mon[35346]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:02.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:02 smithi160 ceph-mon[38982]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:02.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:02 smithi005 ceph-mon[35346]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:02.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:02 smithi204 ceph-mon[39634]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:03.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:03 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-01-24T15:36:03.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:03 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:03.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:03 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-01-24T15:36:03.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:03 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:03.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:03 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-01-24T15:36:03.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:03 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:04.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:04 smithi005 ceph-mon[35346]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:04.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:04 smithi005 ceph-mon[35346]: Deploying daemon osd.2 on smithi204 2024-01-24T15:36:04.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:04 smithi204 ceph-mon[39634]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:04.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:04 smithi204 ceph-mon[39634]: Deploying daemon osd.2 on smithi204 2024-01-24T15:36:04.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:04 smithi160 ceph-mon[38982]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:04.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:04 smithi160 ceph-mon[38982]: Deploying daemon osd.2 on smithi204 2024-01-24T15:36:06.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:06 smithi005 ceph-mon[35346]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:06.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:06 smithi204 ceph-mon[39634]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:06.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:06 smithi160 ceph-mon[38982]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:08.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:08 smithi005 ceph-mon[35346]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:08.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:08 smithi204 ceph-mon[39634]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:08.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:08 smithi160 ceph-mon[38982]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:09.822 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:09 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:09.822 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:09 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:09.822 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:09 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:36:09.823 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:09 smithi204 ceph-mon[39634]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:10.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:09 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:10.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:09 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:10.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:09 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:36:10.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:09 smithi160 ceph-mon[38982]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:10.182 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:09 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:10.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:09 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:10.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:09 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:36:10.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:09 smithi005 ceph-mon[35346]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:11.952 INFO:teuthology.orchestra.run.smithi204.stdout:Created osd(s) 2 on host 'smithi204' 2024-01-24T15:36:11.952 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:11.950+0000 7f308fe00700 1 -- 172.21.15.204:0/1790270384 <== mgr.14150 v2:172.21.15.5:6800/1971309753 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3098061180 con 0x7f30780a0490 2024-01-24T15:36:11.955 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:11.953+0000 7f309e800700 1 -- 172.21.15.204:0/1790270384 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f30780a0490 msgr2=0x7f30780a2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:36:11.955 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:11.953+0000 7f309e800700 1 --2- 172.21.15.204:0/1790270384 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f30780a0490 0x7f30780a2950 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3098101e30 tx=0x7f3088009260 comp rx=0 tx=0).stop 2024-01-24T15:36:11.955 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:11.953+0000 7f309e800700 1 -- 172.21.15.204:0/1790270384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3098101fd0 msgr2=0x7f3098073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:36:11.955 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:11.953+0000 7f309e800700 1 --2- 172.21.15.204:0/1790270384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3098101fd0 0x7f3098073130 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3080004360 tx=0x7f308000b9c0 comp rx=0 tx=0).stop 2024-01-24T15:36:11.955 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:11.953+0000 7f309e800700 1 -- 172.21.15.204:0/1790270384 shutdown_connections 2024-01-24T15:36:11.956 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:11.953+0000 7f309e800700 1 --2- 172.21.15.204:0/1790270384 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f30780a0490 0x7f30780a2950 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:11.956 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:11.953+0000 7f309e800700 1 --2- 172.21.15.204:0/1790270384 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3098102970 0x7f3098073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:11.956 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:11.953+0000 7f309e800700 1 --2- 172.21.15.204:0/1790270384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3098100dd0 0x7f3098074ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:11.956 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:11.953+0000 7f309e800700 1 --2- 172.21.15.204:0/1790270384 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3098101fd0 0x7f3098073130 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:11.956 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:11.953+0000 7f309e800700 1 -- 172.21.15.204:0/1790270384 >> 172.21.15.204:0/1790270384 conn(0x7f30980fc330 msgr2=0x7f30980fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:36:11.956 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:11.954+0000 7f309e800700 1 -- 172.21.15.204:0/1790270384 shutdown_connections 2024-01-24T15:36:11.956 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:11.954+0000 7f309e800700 1 -- 172.21.15.204:0/1790270384 wait complete. 2024-01-24T15:36:12.224 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:11 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:12.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:11 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:12.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:11 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:12.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:11 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:36:12.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:11 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:12.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:11 smithi204 ceph-mon[39634]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:12.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:11 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:36:12.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:11 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:12.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:11 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:12.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:11 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:12.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:11 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:12.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:11 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:12.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:11 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:36:12.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:11 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:12.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:11 smithi160 ceph-mon[38982]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:12.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:11 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:36:12.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:11 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:12.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:11 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:12.432 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:12.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:12.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:12.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:36:12.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:12.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:11 smithi005 ceph-mon[35346]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:12.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:36:12.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:12.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:12.489 DEBUG:teuthology.orchestra.run.smithi204:osd.2> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.2.service 2024-01-24T15:36:12.493 INFO:tasks.cephadm:Deploying osd.3 on smithi005 with /dev/vg_nvme/lv_3... 2024-01-24T15:36:12.493 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-01-24T15:36:12.566 INFO:journalctl@ceph.osd.2.smithi204.stdout:-- Logs begin at Wed 2024-01-24 15:17:05 UTC. -- 2024-01-24T15:36:12.826 INFO:journalctl@ceph.osd.2.smithi204.stdout:Jan 24 15:36:12 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-2[45347]: 2024-01-24T15:36:12.752+0000 7fefe3c71640 -1 osd.2 0 log_to_monitors true 2024-01-24T15:36:12.854 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.a/config 2024-01-24T15:36:13.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:13 smithi005 ceph-mon[35346]: from='osd.2 [v2:172.21.15.204:6800/1780238382,v1:172.21.15.204:6801/1780238382]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-24T15:36:13.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:13 smithi005 ceph-mon[35346]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-24T15:36:13.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:13 smithi204 ceph-mon[39634]: from='osd.2 [v2:172.21.15.204:6800/1780238382,v1:172.21.15.204:6801/1780238382]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-24T15:36:13.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:13 smithi204 ceph-mon[39634]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-24T15:36:13.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:13 smithi160 ceph-mon[38982]: from='osd.2 [v2:172.21.15.204:6800/1780238382,v1:172.21.15.204:6801/1780238382]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-24T15:36:13.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:13 smithi160 ceph-mon[38982]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-24T15:36:14.376 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-01-24T15:36:14.376 INFO:teuthology.orchestra.run.smithi005.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-01-24T15:36:14.376 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10+0 records in 2024-01-24T15:36:14.376 INFO:teuthology.orchestra.run.smithi005.stderr:10+0 records out 2024-01-24T15:36:14.377 INFO:teuthology.orchestra.run.smithi005.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.039195 s, 268 MB/s 2024-01-24T15:36:14.377 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping successful for: 2024-01-24T15:36:14.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:14 smithi005 ceph-mon[35346]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:14.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:14 smithi005 ceph-mon[35346]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-01-24T15:36:14.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:14 smithi005 ceph-mon[35346]: osdmap e16: 3 total, 2 up, 3 in 2024-01-24T15:36:14.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:14 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-24T15:36:14.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:14 smithi005 ceph-mon[35346]: from='osd.2 [v2:172.21.15.204:6800/1780238382,v1:172.21.15.204:6801/1780238382]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]: dispatch 2024-01-24T15:36:14.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:14 smithi005 ceph-mon[35346]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]: dispatch 2024-01-24T15:36:14.725 INFO:journalctl@ceph.osd.2.smithi204.stdout:Jan 24 15:36:14 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-2[45347]: 2024-01-24T15:36:14.428+0000 7fefd7800700 -1 osd.2 0 waiting for initial osdmap 2024-01-24T15:36:14.725 INFO:journalctl@ceph.osd.2.smithi204.stdout:Jan 24 15:36:14 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-2[45347]: 2024-01-24T15:36:14.435+0000 7fefd1200700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T15:36:14.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:14 smithi204 ceph-mon[39634]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:14.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:14 smithi204 ceph-mon[39634]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-01-24T15:36:14.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:14 smithi204 ceph-mon[39634]: osdmap e16: 3 total, 2 up, 3 in 2024-01-24T15:36:14.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:14 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-24T15:36:14.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:14 smithi204 ceph-mon[39634]: from='osd.2 [v2:172.21.15.204:6800/1780238382,v1:172.21.15.204:6801/1780238382]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]: dispatch 2024-01-24T15:36:14.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:14 smithi204 ceph-mon[39634]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]: dispatch 2024-01-24T15:36:14.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:14 smithi160 ceph-mon[38982]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:14.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:14 smithi160 ceph-mon[38982]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-01-24T15:36:14.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:14 smithi160 ceph-mon[38982]: osdmap e16: 3 total, 2 up, 3 in 2024-01-24T15:36:14.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:14 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-24T15:36:14.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:14 smithi160 ceph-mon[38982]: from='osd.2 [v2:172.21.15.204:6800/1780238382,v1:172.21.15.204:6801/1780238382]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]: dispatch 2024-01-24T15:36:14.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:14 smithi160 ceph-mon[38982]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]: dispatch 2024-01-24T15:36:14.767 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph orch daemon add osd smithi005:vg_nvme/lv_3 2024-01-24T15:36:15.123 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.a/config 2024-01-24T15:36:15.632 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:15 smithi005 ceph-mon[35346]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]': finished 2024-01-24T15:36:15.632 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:15 smithi005 ceph-mon[35346]: osdmap e17: 3 total, 2 up, 3 in 2024-01-24T15:36:15.632 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:15 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-24T15:36:15.632 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:15 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-24T15:36:15.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:15 smithi204 ceph-mon[39634]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]': finished 2024-01-24T15:36:15.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:15 smithi204 ceph-mon[39634]: osdmap e17: 3 total, 2 up, 3 in 2024-01-24T15:36:15.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:15 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-24T15:36:15.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:15 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-24T15:36:15.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:15 smithi160 ceph-mon[38982]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]': finished 2024-01-24T15:36:15.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:15 smithi160 ceph-mon[38982]: osdmap e17: 3 total, 2 up, 3 in 2024-01-24T15:36:15.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:15 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-24T15:36:15.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:15 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-24T15:36:16.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.233+0000 7f75ed800700 1 -- 172.21.15.5:0/15592399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75e8101860 msgr2=0x7f75e8103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:36:16.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.233+0000 7f75ed800700 1 --2- 172.21.15.5:0/15592399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75e8101860 0x7f75e8103c50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f75d8009990 tx=0x7f75d8009ca0 comp rx=0 tx=0).stop 2024-01-24T15:36:16.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.233+0000 7f75ed800700 1 -- 172.21.15.5:0/15592399 shutdown_connections 2024-01-24T15:36:16.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.233+0000 7f75ed800700 1 --2- 172.21.15.5:0/15592399 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75e8106ac0 0x7f75e8108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:16.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.233+0000 7f75ed800700 1 --2- 172.21.15.5:0/15592399 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75e8101860 0x7f75e8103c50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:16.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.233+0000 7f75ed800700 1 --2- 172.21.15.5:0/15592399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75e8104190 0x7f75e8106580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:16.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.233+0000 7f75ed800700 1 -- 172.21.15.5:0/15592399 >> 172.21.15.5:0/15592399 conn(0x7f75e80fb250 msgr2=0x7f75e80fd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:36:16.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.233+0000 7f75ed800700 1 -- 172.21.15.5:0/15592399 shutdown_connections 2024-01-24T15:36:16.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.233+0000 7f75ed800700 1 -- 172.21.15.5:0/15592399 wait complete. 2024-01-24T15:36:16.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.234+0000 7f75ed800700 1 Processor -- start 2024-01-24T15:36:16.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.234+0000 7f75ed800700 1 -- start start 2024-01-24T15:36:16.240 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.235+0000 7f75ed800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75e8101860 0x7f75e8198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:36:16.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.235+0000 7f75ed800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75e8104190 0x7f75e81990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:36:16.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.235+0000 7f75ed800700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75e8106ac0 0x7f75e81a0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:36:16.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.235+0000 7f75ed800700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e81a0700 con 0x7f75e8101860 2024-01-24T15:36:16.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.235+0000 7f75ed800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e81a0840 con 0x7f75e8104190 2024-01-24T15:36:16.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.235+0000 7f75ed800700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e81a09d0 con 0x7f75e8106ac0 2024-01-24T15:36:16.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.235+0000 7f75e6a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75e8101860 0x7f75e8198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:36:16.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.235+0000 7f75e6a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75e8101860 0x7f75e8198b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:40738/0 (socket says 172.21.15.5:40738) 2024-01-24T15:36:16.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.235+0000 7f75e6a00700 1 -- 172.21.15.5:0/3036293165 learned_addr learned my addr 172.21.15.5:0/3036293165 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:36:16.241 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.235+0000 7f75e6000700 1 --2- 172.21.15.5:0/3036293165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75e8104190 0x7f75e81990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:36:16.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.235+0000 7f75e7400700 1 --2- 172.21.15.5:0/3036293165 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75e8106ac0 0x7f75e81a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:36:16.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.235+0000 7f75e6a00700 1 -- 172.21.15.5:0/3036293165 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75e8106ac0 msgr2=0x7f75e81a0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:36:16.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.236+0000 7f75e6a00700 1 --2- 172.21.15.5:0/3036293165 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75e8106ac0 0x7f75e81a0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:16.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.236+0000 7f75e6a00700 1 -- 172.21.15.5:0/3036293165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75e8104190 msgr2=0x7f75e81990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:36:16.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.236+0000 7f75e6a00700 1 --2- 172.21.15.5:0/3036293165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75e8104190 0x7f75e81990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:16.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.236+0000 7f75e6a00700 1 -- 172.21.15.5:0/3036293165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d80095f0 con 0x7f75e8101860 2024-01-24T15:36:16.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.236+0000 7f75e6a00700 1 --2- 172.21.15.5:0/3036293165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75e8101860 0x7f75e8198b70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f75d8000c00 tx=0x7f75d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:36:16.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.236+0000 7f75df400700 1 -- 172.21.15.5:0/3036293165 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d801d070 con 0x7f75e8101860 2024-01-24T15:36:16.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.236+0000 7f75df400700 1 -- 172.21.15.5:0/3036293165 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f75d800be30 con 0x7f75e8101860 2024-01-24T15:36:16.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.236+0000 7f75ed800700 1 -- 172.21.15.5:0/3036293165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e81a0c50 con 0x7f75e8101860 2024-01-24T15:36:16.242 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.236+0000 7f75df400700 1 -- 172.21.15.5:0/3036293165 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d8022e00 con 0x7f75e8101860 2024-01-24T15:36:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.236+0000 7f75ed800700 1 -- 172.21.15.5:0/3036293165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e81a1060 con 0x7f75e8101860 2024-01-24T15:36:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.237+0000 7f75ed800700 1 -- 172.21.15.5:0/3036293165 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e8108690 con 0x7f75e8101860 2024-01-24T15:36:16.243 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.239+0000 7f75df400700 1 -- 172.21.15.5:0/3036293165 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 15) v1 ==== 135013+0+0 (secure 0 0 0) 0x7f75d800b9a0 con 0x7f75e8101860 2024-01-24T15:36:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.240+0000 7f75df400700 1 --2- 172.21.15.5:0/3036293165 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f75c80a0510 0x7f75c80a29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:36:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.240+0000 7f75df400700 1 -- 172.21.15.5:0/3036293165 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 2851+0+0 (secure 0 0 0) 0x7f75d80cbac0 con 0x7f75e8101860 2024-01-24T15:36:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.241+0000 7f75e6000700 1 --2- 172.21.15.5:0/3036293165 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f75c80a0510 0x7f75c80a29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:36:16.244 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.241+0000 7f75e6000700 1 --2- 172.21.15.5:0/3036293165 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f75c80a0510 0x7f75c80a29d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f75d000ac50 tx=0x7f75d000a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:36:16.247 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.245+0000 7f75df400700 1 -- 172.21.15.5:0/3036293165 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f75d8096c80 con 0x7f75e8101860 2024-01-24T15:36:16.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:16.460+0000 7f75ed800700 1 -- 172.21.15.5:0/3036293165 --> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f75e8061180 con 0x7f75c80a0510 2024-01-24T15:36:16.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:16 smithi204 ceph-mon[39634]: purged_snaps scrub starts 2024-01-24T15:36:16.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:16 smithi204 ceph-mon[39634]: purged_snaps scrub ok 2024-01-24T15:36:16.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:16 smithi204 ceph-mon[39634]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:16.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:16 smithi204 ceph-mon[39634]: osd.2 [v2:172.21.15.204:6800/1780238382,v1:172.21.15.204:6801/1780238382] boot 2024-01-24T15:36:16.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:16 smithi204 ceph-mon[39634]: osdmap e18: 3 total, 3 up, 3 in 2024-01-24T15:36:16.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:16 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-24T15:36:16.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:16 smithi204 ceph-mon[39634]: Detected new or changed devices on smithi204 2024-01-24T15:36:16.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:16 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:16.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:16 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:16.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:16 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:36:16.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:16 smithi204 ceph-mon[39634]: Adjusting osd_memory_target on smithi204 to 17271M 2024-01-24T15:36:16.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:16 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:16.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:16 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:16.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:16 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:36:16.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:16 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:16.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:16 smithi160 ceph-mon[38982]: purged_snaps scrub starts 2024-01-24T15:36:16.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:16 smithi160 ceph-mon[38982]: purged_snaps scrub ok 2024-01-24T15:36:16.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:16 smithi160 ceph-mon[38982]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:16.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:16 smithi160 ceph-mon[38982]: osd.2 [v2:172.21.15.204:6800/1780238382,v1:172.21.15.204:6801/1780238382] boot 2024-01-24T15:36:16.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:16 smithi160 ceph-mon[38982]: osdmap e18: 3 total, 3 up, 3 in 2024-01-24T15:36:16.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:16 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-24T15:36:16.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:16 smithi160 ceph-mon[38982]: Detected new or changed devices on smithi204 2024-01-24T15:36:16.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:16 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:16.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:16 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:16.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:16 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:36:16.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:16 smithi160 ceph-mon[38982]: Adjusting osd_memory_target on smithi204 to 17271M 2024-01-24T15:36:16.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:16 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:16.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:16 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:16.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:16 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:36:16.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:16 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:16.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:16 smithi005 ceph-mon[35346]: purged_snaps scrub starts 2024-01-24T15:36:16.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:16 smithi005 ceph-mon[35346]: purged_snaps scrub ok 2024-01-24T15:36:16.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:16 smithi005 ceph-mon[35346]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-01-24T15:36:16.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:16 smithi005 ceph-mon[35346]: osd.2 [v2:172.21.15.204:6800/1780238382,v1:172.21.15.204:6801/1780238382] boot 2024-01-24T15:36:16.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:16 smithi005 ceph-mon[35346]: osdmap e18: 3 total, 3 up, 3 in 2024-01-24T15:36:16.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:16 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-24T15:36:16.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:16 smithi005 ceph-mon[35346]: Detected new or changed devices on smithi204 2024-01-24T15:36:16.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:16 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:16.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:16 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:16.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:16 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:36:16.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:16 smithi005 ceph-mon[35346]: Adjusting osd_memory_target on smithi204 to 17271M 2024-01-24T15:36:16.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:16 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:16.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:16 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:16.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:16 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:36:16.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:16 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:18.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:17 smithi005 ceph-mon[35346]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:36:18.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:17 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:36:18.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:17 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:36:18.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:17 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:18.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:17 smithi005 ceph-mon[35346]: osdmap e19: 3 total, 3 up, 3 in 2024-01-24T15:36:18.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:17 smithi204 ceph-mon[39634]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:36:18.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:17 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:36:18.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:17 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:36:18.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:17 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:18.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:17 smithi204 ceph-mon[39634]: osdmap e19: 3 total, 3 up, 3 in 2024-01-24T15:36:18.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:17 smithi160 ceph-mon[38982]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:36:18.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:17 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:36:18.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:17 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:36:18.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:17 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:18.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:17 smithi160 ceph-mon[38982]: osdmap e19: 3 total, 3 up, 3 in 2024-01-24T15:36:19.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:18 smithi005 ceph-mon[35346]: pgmap v74: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-01-24T15:36:19.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:18 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-01-24T15:36:19.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:18 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-01-24T15:36:19.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:18 smithi005 ceph-mon[35346]: osdmap e20: 3 total, 3 up, 3 in 2024-01-24T15:36:19.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:18 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-01-24T15:36:19.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:18 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/3337351554' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a086309-5d6b-4226-93d0-e3e55ced7172"}]: dispatch 2024-01-24T15:36:19.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:18 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-01-24T15:36:19.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:18 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/3337351554' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a086309-5d6b-4226-93d0-e3e55ced7172"}]': finished 2024-01-24T15:36:19.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:18 smithi005 ceph-mon[35346]: osdmap e21: 4 total, 3 up, 4 in 2024-01-24T15:36:19.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:18 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-24T15:36:19.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:18 smithi204 ceph-mon[39634]: pgmap v74: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-01-24T15:36:19.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:18 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-01-24T15:36:19.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:18 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-01-24T15:36:19.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:18 smithi204 ceph-mon[39634]: osdmap e20: 3 total, 3 up, 3 in 2024-01-24T15:36:19.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:18 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-01-24T15:36:19.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:18 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/3337351554' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a086309-5d6b-4226-93d0-e3e55ced7172"}]: dispatch 2024-01-24T15:36:19.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:18 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-01-24T15:36:19.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:18 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/3337351554' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a086309-5d6b-4226-93d0-e3e55ced7172"}]': finished 2024-01-24T15:36:19.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:18 smithi204 ceph-mon[39634]: osdmap e21: 4 total, 3 up, 4 in 2024-01-24T15:36:19.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:18 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-24T15:36:19.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:18 smithi160 ceph-mon[38982]: pgmap v74: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-01-24T15:36:19.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:18 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-01-24T15:36:19.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:18 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-01-24T15:36:19.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:18 smithi160 ceph-mon[38982]: osdmap e20: 3 total, 3 up, 3 in 2024-01-24T15:36:19.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:18 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-01-24T15:36:19.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:18 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/3337351554' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4a086309-5d6b-4226-93d0-e3e55ced7172"}]: dispatch 2024-01-24T15:36:19.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:18 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-01-24T15:36:19.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:18 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/3337351554' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4a086309-5d6b-4226-93d0-e3e55ced7172"}]': finished 2024-01-24T15:36:19.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:18 smithi160 ceph-mon[38982]: osdmap e21: 4 total, 3 up, 4 in 2024-01-24T15:36:19.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:18 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-24T15:36:19.683 INFO:journalctl@ceph.osd.0.smithi005.stdout:Jan 24 15:36:19 smithi005 sudo[59719]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-01-24T15:36:19.683 INFO:journalctl@ceph.osd.0.smithi005.stdout:Jan 24 15:36:19 smithi005 sudo[59719]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-24T15:36:19.683 INFO:journalctl@ceph.osd.0.smithi005.stdout:Jan 24 15:36:19 smithi005 sudo[59719]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-24T15:36:19.683 INFO:journalctl@ceph.osd.0.smithi005.stdout:Jan 24 15:36:19 smithi005 sudo[59719]: pam_unix(sudo:session): session closed for user root 2024-01-24T15:36:19.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:19.784+0000 7f75df400700 1 -- 172.21.15.5:0/3036293165 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f75d8097050 con 0x7f75e8101860 2024-01-24T15:36:20.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:19 smithi005 ceph-mon[35346]: pgmap v77: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-01-24T15:36:20.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:19 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/1990909403' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:36:20.183 INFO:journalctl@ceph.osd.0.smithi005.stdout:Jan 24 15:36:19 smithi005 sudo[59773]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-01-24T15:36:20.183 INFO:journalctl@ceph.osd.0.smithi005.stdout:Jan 24 15:36:19 smithi005 sudo[59773]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-24T15:36:20.183 INFO:journalctl@ceph.osd.0.smithi005.stdout:Jan 24 15:36:19 smithi005 sudo[59773]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-24T15:36:20.183 INFO:journalctl@ceph.osd.0.smithi005.stdout:Jan 24 15:36:19 smithi005 sudo[59773]: pam_unix(sudo:session): session closed for user root 2024-01-24T15:36:20.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:19 smithi204 ceph-mon[39634]: pgmap v77: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-01-24T15:36:20.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:19 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/1990909403' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:36:20.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:19 smithi160 ceph-mon[38982]: pgmap v77: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-01-24T15:36:20.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:19 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/1990909403' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:36:20.782 INFO:journalctl@ceph.osd.1.smithi160.stdout:Jan 24 15:36:20 smithi160 sudo[48627]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-01-24T15:36:20.782 INFO:journalctl@ceph.osd.1.smithi160.stdout:Jan 24 15:36:20 smithi160 sudo[48627]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-24T15:36:20.782 INFO:journalctl@ceph.osd.1.smithi160.stdout:Jan 24 15:36:20 smithi160 sudo[48627]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-24T15:36:20.782 INFO:journalctl@ceph.osd.1.smithi160.stdout:Jan 24 15:36:20 smithi160 sudo[48627]: pam_unix(sudo:session): session closed for user root 2024-01-24T15:36:21.037 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:20 smithi160 ceph-mon[38982]: osdmap e22: 4 total, 3 up, 4 in 2024-01-24T15:36:21.037 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:20 smithi160 ceph-mon[38982]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-01-24T15:36:21.037 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:20 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-24T15:36:21.037 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:20 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:21.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:20 smithi005 ceph-mon[35346]: osdmap e22: 4 total, 3 up, 4 in 2024-01-24T15:36:21.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:20 smithi005 ceph-mon[35346]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-01-24T15:36:21.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:20 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-24T15:36:21.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:20 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:21.224 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:20 smithi204 ceph-mon[39634]: osdmap e22: 4 total, 3 up, 4 in 2024-01-24T15:36:21.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:20 smithi204 ceph-mon[39634]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-01-24T15:36:21.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:20 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-24T15:36:21.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:20 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:21.506 INFO:journalctl@ceph.osd.1.smithi160.stdout:Jan 24 15:36:21 smithi160 sudo[48630]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-01-24T15:36:21.507 INFO:journalctl@ceph.osd.1.smithi160.stdout:Jan 24 15:36:21 smithi160 sudo[48630]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-24T15:36:21.507 INFO:journalctl@ceph.osd.1.smithi160.stdout:Jan 24 15:36:21 smithi160 sudo[48630]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-24T15:36:21.507 INFO:journalctl@ceph.osd.1.smithi160.stdout:Jan 24 15:36:21 smithi160 sudo[48630]: pam_unix(sudo:session): session closed for user root 2024-01-24T15:36:21.975 INFO:journalctl@ceph.osd.2.smithi204.stdout:Jan 24 15:36:21 smithi204 sudo[50046]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-01-24T15:36:21.975 INFO:journalctl@ceph.osd.2.smithi204.stdout:Jan 24 15:36:21 smithi204 sudo[50046]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-24T15:36:21.975 INFO:journalctl@ceph.osd.2.smithi204.stdout:Jan 24 15:36:21 smithi204 sudo[50046]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-24T15:36:21.975 INFO:journalctl@ceph.osd.2.smithi204.stdout:Jan 24 15:36:21 smithi204 sudo[50046]: pam_unix(sudo:session): session closed for user root 2024-01-24T15:36:22.432 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:22 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:22.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:22 smithi005 ceph-mon[35346]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-01-24T15:36:22.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:22 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:22.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:22 smithi204 ceph-mon[39634]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-01-24T15:36:22.475 INFO:journalctl@ceph.osd.2.smithi204.stdout:Jan 24 15:36:22 smithi204 sudo[50049]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-01-24T15:36:22.475 INFO:journalctl@ceph.osd.2.smithi204.stdout:Jan 24 15:36:22 smithi204 sudo[50049]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-24T15:36:22.475 INFO:journalctl@ceph.osd.2.smithi204.stdout:Jan 24 15:36:22 smithi204 sudo[50049]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-24T15:36:22.475 INFO:journalctl@ceph.osd.2.smithi204.stdout:Jan 24 15:36:22 smithi204 sudo[50049]: pam_unix(sudo:session): session closed for user root 2024-01-24T15:36:22.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:22 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:22.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:22 smithi160 ceph-mon[38982]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-01-24T15:36:22.918 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:22 smithi005 sudo[61024]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-01-24T15:36:22.918 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:22 smithi005 sudo[61024]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-24T15:36:22.918 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:22 smithi005 sudo[61024]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-24T15:36:22.918 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:22 smithi005 sudo[61024]: pam_unix(sudo:session): session closed for user root 2024-01-24T15:36:23.432 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:23 smithi005 sudo[61116]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-01-24T15:36:23.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:23 smithi005 sudo[61116]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-24T15:36:23.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:23 smithi005 sudo[61116]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-24T15:36:23.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:23 smithi005 sudo[61116]: pam_unix(sudo:session): session closed for user root 2024-01-24T15:36:23.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:23 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:23.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:23 smithi005 ceph-mon[35346]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-24T15:36:23.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:23 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:23.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:23 smithi160 ceph-mon[38982]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-24T15:36:23.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:23 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:23.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:23 smithi204 ceph-mon[39634]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-24T15:36:24.224 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:23 smithi204 sudo[50052]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-01-24T15:36:24.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:23 smithi204 sudo[50052]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-24T15:36:24.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:23 smithi204 sudo[50052]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-24T15:36:24.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:23 smithi204 sudo[50052]: pam_unix(sudo:session): session closed for user root 2024-01-24T15:36:24.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:24 smithi005 ceph-mon[35346]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 81 MiB used, 268 GiB / 268 GiB avail 2024-01-24T15:36:24.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:24 smithi005 ceph-mon[35346]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-24T15:36:24.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:24 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-24T15:36:24.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:24 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:36:24.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:24 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:36:24.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:24 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-24T15:36:24.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:24 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:36:24.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:24 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:36:24.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:24 smithi204 sudo[50055]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-01-24T15:36:24.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:24 smithi204 sudo[50055]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-24T15:36:24.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:24 smithi204 sudo[50055]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-24T15:36:24.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:24 smithi204 sudo[50055]: pam_unix(sudo:session): session closed for user root 2024-01-24T15:36:24.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:24 smithi204 ceph-mon[39634]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 81 MiB used, 268 GiB / 268 GiB avail 2024-01-24T15:36:24.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:24 smithi204 ceph-mon[39634]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-24T15:36:24.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:24 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-24T15:36:24.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:24 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:36:24.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:24 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:36:24.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:24 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-24T15:36:24.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:24 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:36:24.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:24 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:36:25.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:24 smithi160 sudo[48633]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-01-24T15:36:25.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:24 smithi160 sudo[48633]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-24T15:36:25.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:24 smithi160 sudo[48633]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-24T15:36:25.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:24 smithi160 sudo[48633]: pam_unix(sudo:session): session closed for user root 2024-01-24T15:36:25.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:25 smithi005 ceph-mon[35346]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-24T15:36:25.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:25 smithi005 ceph-mon[35346]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-24T15:36:25.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:25 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-24T15:36:25.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:25 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:36:25.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:25 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:36:25.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:25 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-01-24T15:36:25.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:25 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:25.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:25 smithi204 ceph-mon[39634]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-24T15:36:25.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:25 smithi204 ceph-mon[39634]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-24T15:36:25.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:25 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-24T15:36:25.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:25 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:36:25.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:25 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:36:25.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:25 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-01-24T15:36:25.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:25 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:25.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:25 smithi160 sudo[48636]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-01-24T15:36:25.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:25 smithi160 sudo[48636]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-24T15:36:25.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:25 smithi160 sudo[48636]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-24T15:36:25.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:25 smithi160 sudo[48636]: pam_unix(sudo:session): session closed for user root 2024-01-24T15:36:25.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:25 smithi160 ceph-mon[38982]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 81 MiB used, 268 GiB / 268 GiB avail 2024-01-24T15:36:25.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:25 smithi160 ceph-mon[38982]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-24T15:36:25.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:25 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-24T15:36:25.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:25 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:36:25.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:25 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:36:25.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:25 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-24T15:36:25.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:25 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:36:25.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:25 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:36:25.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:25 smithi160 ceph-mon[38982]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-24T15:36:25.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:25 smithi160 ceph-mon[38982]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-24T15:36:25.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:25 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-24T15:36:25.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:25 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-24T15:36:25.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:25 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-24T15:36:25.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:25 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-01-24T15:36:25.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:25 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:26.432 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:26 smithi005 ceph-mon[35346]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-24T15:36:26.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:26 smithi005 ceph-mon[35346]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-01-24T15:36:26.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:26 smithi005 ceph-mon[35346]: Deploying daemon osd.3 on smithi005 2024-01-24T15:36:26.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:26 smithi005 ceph-mon[35346]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-24T15:36:26.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:26 smithi204 ceph-mon[39634]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-24T15:36:26.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:26 smithi204 ceph-mon[39634]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-01-24T15:36:26.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:26 smithi204 ceph-mon[39634]: Deploying daemon osd.3 on smithi005 2024-01-24T15:36:26.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:26 smithi204 ceph-mon[39634]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-24T15:36:26.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:26 smithi160 ceph-mon[38982]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-24T15:36:26.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:26 smithi160 ceph-mon[38982]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-01-24T15:36:26.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:26 smithi160 ceph-mon[38982]: Deploying daemon osd.3 on smithi005 2024-01-24T15:36:26.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:26 smithi160 ceph-mon[38982]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-24T15:36:28.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:28 smithi005 ceph-mon[35346]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-01-24T15:36:28.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:28 smithi204 ceph-mon[39634]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-01-24T15:36:28.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:28 smithi160 ceph-mon[38982]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail 2024-01-24T15:36:30.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:30 smithi005 ceph-mon[35346]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-01-24T15:36:30.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:30 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:30.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:30 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:30.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:30 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:36:30.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:30 smithi204 ceph-mon[39634]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-01-24T15:36:30.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:30 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:30.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:30 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:30.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:30 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:36:30.760 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:30 smithi160 ceph-mon[38982]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-01-24T15:36:30.760 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:30 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:30.760 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:30 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:30.760 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:30 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:36:32.679 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:32 smithi005 ceph-mon[35346]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-01-24T15:36:32.679 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:32.679 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:32.679 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:32.679 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:36:32.679 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:32 smithi204 ceph-mon[39634]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-01-24T15:36:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:36:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:32.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:32 smithi160 ceph-mon[38982]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-01-24T15:36:32.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:32.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:32.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:32.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:36:32.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:32.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:32.910+0000 7f75df400700 1 -- 172.21.15.5:0/3036293165 <== mgr.14150 v2:172.21.15.5:6800/1971309753 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f75e8061180 con 0x7f75c80a0510 2024-01-24T15:36:32.912 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 3 on host 'smithi005' 2024-01-24T15:36:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:32.912+0000 7f75ed800700 1 -- 172.21.15.5:0/3036293165 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f75c80a0510 msgr2=0x7f75c80a29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:36:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:32.912+0000 7f75ed800700 1 --2- 172.21.15.5:0/3036293165 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f75c80a0510 0x7f75c80a29d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f75d000ac50 tx=0x7f75d000a380 comp rx=0 tx=0).stop 2024-01-24T15:36:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:32.912+0000 7f75ed800700 1 -- 172.21.15.5:0/3036293165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75e8101860 msgr2=0x7f75e8198b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:36:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:32.912+0000 7f75ed800700 1 --2- 172.21.15.5:0/3036293165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75e8101860 0x7f75e8198b70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f75d8000c00 tx=0x7f75d8004730 comp rx=0 tx=0).stop 2024-01-24T15:36:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:32.912+0000 7f75ed800700 1 -- 172.21.15.5:0/3036293165 shutdown_connections 2024-01-24T15:36:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:32.912+0000 7f75ed800700 1 --2- 172.21.15.5:0/3036293165 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f75e8106ac0 0x7f75e81a0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:32.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:32.912+0000 7f75ed800700 1 --2- 172.21.15.5:0/3036293165 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f75c80a0510 0x7f75c80a29d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:32.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:32.912+0000 7f75ed800700 1 --2- 172.21.15.5:0/3036293165 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f75e8101860 0x7f75e8198b70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:32.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:32.912+0000 7f75ed800700 1 --2- 172.21.15.5:0/3036293165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75e8104190 0x7f75e81990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:32.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:32.912+0000 7f75ed800700 1 -- 172.21.15.5:0/3036293165 >> 172.21.15.5:0/3036293165 conn(0x7f75e80fb250 msgr2=0x7f75e80ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:36:32.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:32.913+0000 7f75ed800700 1 -- 172.21.15.5:0/3036293165 shutdown_connections 2024-01-24T15:36:32.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:36:32.913+0000 7f75ed800700 1 -- 172.21.15.5:0/3036293165 wait complete. 2024-01-24T15:36:33.270 DEBUG:teuthology.orchestra.run.smithi005:osd.3> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.3.service 2024-01-24T15:36:33.275 INFO:tasks.cephadm:Deploying osd.4 on smithi160 with /dev/vg_nvme/lv_3... 2024-01-24T15:36:33.276 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-01-24T15:36:33.356 INFO:journalctl@ceph.osd.3.smithi005.stdout:-- Logs begin at Wed 2024-01-24 15:16:42 UTC. -- 2024-01-24T15:36:33.634 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.b/config 2024-01-24T15:36:34.120 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:33 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:34.121 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:33 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:36:34.121 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:33 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:34.121 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:33 smithi160 ceph-mon[38982]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-01-24T15:36:34.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:33 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:34.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:33 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:36:34.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:33 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:34.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:33 smithi005 ceph-mon[35346]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-01-24T15:36:34.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:33 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:34.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:33 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:36:34.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:33 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:34.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:33 smithi204 ceph-mon[39634]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-01-24T15:36:34.432 INFO:journalctl@ceph.osd.3.smithi005.stdout:Jan 24 15:36:34 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-3[61955]: 2024-01-24T15:36:34.133+0000 7f5f42b7f640 -1 osd.3 0 log_to_monitors true 2024-01-24T15:36:35.176 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-01-24T15:36:35.176 INFO:teuthology.orchestra.run.smithi160.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-01-24T15:36:35.176 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10+0 records in 2024-01-24T15:36:35.176 INFO:teuthology.orchestra.run.smithi160.stderr:10+0 records out 2024-01-24T15:36:35.177 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0297992 s, 352 MB/s 2024-01-24T15:36:35.177 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping successful for: 2024-01-24T15:36:35.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:34 smithi005 ceph-mon[35346]: from='osd.3 [v2:172.21.15.5:6810/2647874051,v1:172.21.15.5:6811/2647874051]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-01-24T15:36:35.212 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:34 smithi160 ceph-mon[38982]: from='osd.3 [v2:172.21.15.5:6810/2647874051,v1:172.21.15.5:6811/2647874051]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-01-24T15:36:35.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:34 smithi204 ceph-mon[39634]: from='osd.3 [v2:172.21.15.5:6810/2647874051,v1:172.21.15.5:6811/2647874051]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-01-24T15:36:35.481 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph orch daemon add osd smithi160:vg_nvme/lv_3 2024-01-24T15:36:35.830 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.b/config 2024-01-24T15:36:36.183 INFO:journalctl@ceph.osd.3.smithi005.stdout:Jan 24 15:36:35 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-3[61955]: 2024-01-24T15:36:35.881+0000 7f5f36800700 -1 osd.3 0 waiting for initial osdmap 2024-01-24T15:36:36.183 INFO:journalctl@ceph.osd.3.smithi005.stdout:Jan 24 15:36:35 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-3[61955]: 2024-01-24T15:36:35.889+0000 7f5f30200700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T15:36:36.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:35 smithi005 ceph-mon[35346]: from='osd.3 [v2:172.21.15.5:6810/2647874051,v1:172.21.15.5:6811/2647874051]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-01-24T15:36:36.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:35 smithi005 ceph-mon[35346]: osdmap e23: 4 total, 3 up, 4 in 2024-01-24T15:36:36.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:35 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-24T15:36:36.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:35 smithi005 ceph-mon[35346]: from='osd.3 [v2:172.21.15.5:6810/2647874051,v1:172.21.15.5:6811/2647874051]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-01-24T15:36:36.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:35 smithi005 ceph-mon[35346]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-01-24T15:36:36.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:35 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:36.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:35 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:36.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:35 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:36:36.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:35 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:36:36.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:35 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:36.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:35 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:36.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:35 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:36:36.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:35 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:36.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:35 smithi204 ceph-mon[39634]: from='osd.3 [v2:172.21.15.5:6810/2647874051,v1:172.21.15.5:6811/2647874051]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-01-24T15:36:36.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:35 smithi204 ceph-mon[39634]: osdmap e23: 4 total, 3 up, 4 in 2024-01-24T15:36:36.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:35 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-24T15:36:36.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:35 smithi204 ceph-mon[39634]: from='osd.3 [v2:172.21.15.5:6810/2647874051,v1:172.21.15.5:6811/2647874051]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-01-24T15:36:36.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:35 smithi204 ceph-mon[39634]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-01-24T15:36:36.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:35 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:36.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:35 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:36.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:35 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:36:36.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:35 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:36:36.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:35 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:36.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:35 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:36.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:35 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:36:36.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:35 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:36.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:35 smithi160 ceph-mon[38982]: from='osd.3 [v2:172.21.15.5:6810/2647874051,v1:172.21.15.5:6811/2647874051]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-01-24T15:36:36.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:35 smithi160 ceph-mon[38982]: osdmap e23: 4 total, 3 up, 4 in 2024-01-24T15:36:36.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:35 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-24T15:36:36.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:35 smithi160 ceph-mon[38982]: from='osd.3 [v2:172.21.15.5:6810/2647874051,v1:172.21.15.5:6811/2647874051]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-01-24T15:36:36.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:35 smithi160 ceph-mon[38982]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 83 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-01-24T15:36:36.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:35 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:36.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:35 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:36.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:35 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:36:36.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:35 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:36:36.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:35 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:36.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:35 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:36.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:35 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:36:36.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:35 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:36.894 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.891+0000 7f949b600700 1 -- 172.21.15.160:0/1881982676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9494101fd0 msgr2=0x7f9494102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:36:36.894 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.891+0000 7f949b600700 1 --2- 172.21.15.160:0/1881982676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9494101fd0 0x7f9494102430 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f947c0099c0 tx=0x7f947c009cd0 comp rx=0 tx=0).stop 2024-01-24T15:36:36.894 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.891+0000 7f949b600700 1 -- 172.21.15.160:0/1881982676 shutdown_connections 2024-01-24T15:36:36.894 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.891+0000 7f949b600700 1 --2- 172.21.15.160:0/1881982676 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9494102970 0x7f9494109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:36.894 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.891+0000 7f949b600700 1 --2- 172.21.15.160:0/1881982676 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9494100dd0 0x7f94941011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:36.894 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.891+0000 7f949b600700 1 --2- 172.21.15.160:0/1881982676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9494101fd0 0x7f9494102430 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:36.895 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.891+0000 7f949b600700 1 -- 172.21.15.160:0/1881982676 >> 172.21.15.160:0/1881982676 conn(0x7f94940fc330 msgr2=0x7f94940fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:36:36.895 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.891+0000 7f949b600700 1 -- 172.21.15.160:0/1881982676 shutdown_connections 2024-01-24T15:36:36.895 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.891+0000 7f949b600700 1 -- 172.21.15.160:0/1881982676 wait complete. 2024-01-24T15:36:36.895 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.893+0000 7f949b600700 1 Processor -- start 2024-01-24T15:36:36.895 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.893+0000 7f949b600700 1 -- start start 2024-01-24T15:36:36.897 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.893+0000 7f949b600700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9494100dd0 0x7f9494074ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:36:36.897 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.893+0000 7f949b600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9494101fd0 0x7f9494073130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:36:36.897 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.893+0000 7f949b600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9494102970 0x7f9494073670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:36:36.897 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.894+0000 7f949b600700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9494073df0 con 0x7f9494102970 2024-01-24T15:36:36.897 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.894+0000 7f949b600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9494073f60 con 0x7f9494101fd0 2024-01-24T15:36:36.897 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.894+0000 7f949b600700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94941a0a80 con 0x7f9494100dd0 2024-01-24T15:36:36.898 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.894+0000 7f948bc00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9494101fd0 0x7f9494073130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:36:36.898 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.894+0000 7f948bc00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9494101fd0 0x7f9494073130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:47366/0 (socket says 172.21.15.160:47366) 2024-01-24T15:36:36.898 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.894+0000 7f948bc00700 1 -- 172.21.15.160:0/2142404558 learned_addr learned my addr 172.21.15.160:0/2142404558 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-01-24T15:36:36.898 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.894+0000 7f9498c00700 1 --2- 172.21.15.160:0/2142404558 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9494100dd0 0x7f9494074ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:36:36.898 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.894+0000 7f9499600700 1 --2- 172.21.15.160:0/2142404558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9494102970 0x7f9494073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:36:36.898 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.894+0000 7f948bc00700 1 -- 172.21.15.160:0/2142404558 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9494100dd0 msgr2=0x7f9494074ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:36:36.898 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.894+0000 7f948bc00700 1 --2- 172.21.15.160:0/2142404558 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9494100dd0 0x7f9494074ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:36.898 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.894+0000 7f948bc00700 1 -- 172.21.15.160:0/2142404558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9494102970 msgr2=0x7f9494073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:36:36.898 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.894+0000 7f948bc00700 1 --2- 172.21.15.160:0/2142404558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9494102970 0x7f9494073670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:36.898 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.894+0000 7f948bc00700 1 -- 172.21.15.160:0/2142404558 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c0095f0 con 0x7f9494101fd0 2024-01-24T15:36:36.898 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.894+0000 7f948bc00700 1 --2- 172.21.15.160:0/2142404558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9494101fd0 0x7f9494073130 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f947c000c00 tx=0x7f947c00fab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:36:36.898 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.895+0000 7f9492000700 1 -- 172.21.15.160:0/2142404558 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c01d070 con 0x7f9494101fd0 2024-01-24T15:36:36.898 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.895+0000 7f9492000700 1 -- 172.21.15.160:0/2142404558 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f947c00bcf0 con 0x7f9494101fd0 2024-01-24T15:36:36.898 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.895+0000 7f949b600700 1 -- 172.21.15.160:0/2142404558 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94941a0d00 con 0x7f9494101fd0 2024-01-24T15:36:36.899 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.895+0000 7f9492000700 1 -- 172.21.15.160:0/2142404558 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c004c60 con 0x7f9494101fd0 2024-01-24T15:36:36.899 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.895+0000 7f949b600700 1 -- 172.21.15.160:0/2142404558 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94941a1110 con 0x7f9494101fd0 2024-01-24T15:36:36.899 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.896+0000 7f949b600700 1 -- 172.21.15.160:0/2142404558 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94941084a0 con 0x7f9494101fd0 2024-01-24T15:36:36.900 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.898+0000 7f9492000700 1 -- 172.21.15.160:0/2142404558 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f947c005570 con 0x7f9494101fd0 2024-01-24T15:36:36.901 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.899+0000 7f9492000700 1 --2- 172.21.15.160:0/2142404558 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f94740a0520 0x7f94740a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:36:36.902 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.899+0000 7f9492000700 1 -- 172.21.15.160:0/2142404558 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f947c0cb710 con 0x7f9494101fd0 2024-01-24T15:36:36.902 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.899+0000 7f9498c00700 1 --2- 172.21.15.160:0/2142404558 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f94740a0520 0x7f94740a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:36:36.903 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.900+0000 7f9498c00700 1 --2- 172.21.15.160:0/2142404558 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f94740a0520 0x7f94740a29e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9494101e30 tx=0x7f948400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:36:36.907 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:36.904+0000 7f9492000700 1 -- 172.21.15.160:0/2142404558 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f947c0964a0 con 0x7f9494101fd0 2024-01-24T15:36:37.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:36 smithi160 ceph-mon[38982]: Detected new or changed devices on smithi005 2024-01-24T15:36:37.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:36 smithi160 ceph-mon[38982]: Adjusting osd_memory_target on smithi005 to 8638M 2024-01-24T15:36:37.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:36 smithi160 ceph-mon[38982]: from='osd.3 [v2:172.21.15.5:6810/2647874051,v1:172.21.15.5:6811/2647874051]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-01-24T15:36:37.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:36 smithi160 ceph-mon[38982]: osdmap e24: 4 total, 3 up, 4 in 2024-01-24T15:36:37.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:36 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-24T15:36:37.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:36 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-24T15:36:37.113 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:37.110+0000 7f949b600700 1 -- 172.21.15.160:0/2142404558 --> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f9494061180 con 0x7f94740a0520 2024-01-24T15:36:37.182 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:36 smithi005 ceph-mon[35346]: Detected new or changed devices on smithi005 2024-01-24T15:36:37.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:36 smithi005 ceph-mon[35346]: Adjusting osd_memory_target on smithi005 to 8638M 2024-01-24T15:36:37.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:36 smithi005 ceph-mon[35346]: from='osd.3 [v2:172.21.15.5:6810/2647874051,v1:172.21.15.5:6811/2647874051]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-01-24T15:36:37.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:36 smithi005 ceph-mon[35346]: osdmap e24: 4 total, 3 up, 4 in 2024-01-24T15:36:37.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:36 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-24T15:36:37.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:36 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-24T15:36:37.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:36 smithi204 ceph-mon[39634]: Detected new or changed devices on smithi005 2024-01-24T15:36:37.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:36 smithi204 ceph-mon[39634]: Adjusting osd_memory_target on smithi005 to 8638M 2024-01-24T15:36:37.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:36 smithi204 ceph-mon[39634]: from='osd.3 [v2:172.21.15.5:6810/2647874051,v1:172.21.15.5:6811/2647874051]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-01-24T15:36:37.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:36 smithi204 ceph-mon[39634]: osdmap e24: 4 total, 3 up, 4 in 2024-01-24T15:36:37.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:36 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-24T15:36:37.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:36 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-24T15:36:38.003 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:37 smithi160 ceph-mon[38982]: purged_snaps scrub starts 2024-01-24T15:36:38.004 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:37 smithi160 ceph-mon[38982]: purged_snaps scrub ok 2024-01-24T15:36:38.004 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:37 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-24T15:36:38.004 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:37 smithi160 ceph-mon[38982]: osd.3 [v2:172.21.15.5:6810/2647874051,v1:172.21.15.5:6811/2647874051] boot 2024-01-24T15:36:38.004 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:37 smithi160 ceph-mon[38982]: osdmap e25: 4 total, 4 up, 4 in 2024-01-24T15:36:38.004 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:37 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-24T15:36:38.004 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:37 smithi160 ceph-mon[38982]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:36:38.004 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:37 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:36:38.004 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:37 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:36:38.004 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:37 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:38.004 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:37 smithi160 ceph-mon[38982]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-01-24T15:36:38.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:37 smithi005 ceph-mon[35346]: purged_snaps scrub starts 2024-01-24T15:36:38.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:37 smithi005 ceph-mon[35346]: purged_snaps scrub ok 2024-01-24T15:36:38.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:37 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-24T15:36:38.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:37 smithi005 ceph-mon[35346]: osd.3 [v2:172.21.15.5:6810/2647874051,v1:172.21.15.5:6811/2647874051] boot 2024-01-24T15:36:38.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:37 smithi005 ceph-mon[35346]: osdmap e25: 4 total, 4 up, 4 in 2024-01-24T15:36:38.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:37 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-24T15:36:38.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:37 smithi005 ceph-mon[35346]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:36:38.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:37 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:36:38.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:37 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:36:38.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:37 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:38.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:37 smithi005 ceph-mon[35346]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-01-24T15:36:38.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:37 smithi204 ceph-mon[39634]: purged_snaps scrub starts 2024-01-24T15:36:38.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:37 smithi204 ceph-mon[39634]: purged_snaps scrub ok 2024-01-24T15:36:38.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:37 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-24T15:36:38.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:37 smithi204 ceph-mon[39634]: osd.3 [v2:172.21.15.5:6810/2647874051,v1:172.21.15.5:6811/2647874051] boot 2024-01-24T15:36:38.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:37 smithi204 ceph-mon[39634]: osdmap e25: 4 total, 4 up, 4 in 2024-01-24T15:36:38.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:37 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-24T15:36:38.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:37 smithi204 ceph-mon[39634]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:36:38.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:37 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:36:38.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:37 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:36:38.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:37 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:38.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:37 smithi204 ceph-mon[39634]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-01-24T15:36:39.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:38 smithi005 ceph-mon[35346]: osdmap e26: 4 total, 4 up, 4 in 2024-01-24T15:36:39.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:38 smithi204 ceph-mon[39634]: osdmap e26: 4 total, 4 up, 4 in 2024-01-24T15:36:39.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:38 smithi160 ceph-mon[38982]: osdmap e26: 4 total, 4 up, 4 in 2024-01-24T15:36:40.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:39 smithi005 ceph-mon[35346]: osdmap e27: 4 total, 4 up, 4 in 2024-01-24T15:36:40.185 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:39 smithi005 ceph-mon[35346]: pgmap v93: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-01-24T15:36:40.185 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:39 smithi005 ceph-mon[35346]: from='client.? 172.21.15.160:0/3995049693' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "27d27d11-ef97-4faf-b5fb-c744bbdbcf9a"}]: dispatch 2024-01-24T15:36:40.185 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:39 smithi005 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "27d27d11-ef97-4faf-b5fb-c744bbdbcf9a"}]: dispatch 2024-01-24T15:36:40.185 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:39 smithi005 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "27d27d11-ef97-4faf-b5fb-c744bbdbcf9a"}]': finished 2024-01-24T15:36:40.185 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:39 smithi005 ceph-mon[35346]: osdmap e28: 5 total, 4 up, 5 in 2024-01-24T15:36:40.185 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:39 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-24T15:36:40.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:39 smithi204 ceph-mon[39634]: osdmap e27: 4 total, 4 up, 4 in 2024-01-24T15:36:40.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:39 smithi204 ceph-mon[39634]: pgmap v93: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-01-24T15:36:40.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:39 smithi204 ceph-mon[39634]: from='client.? 172.21.15.160:0/3995049693' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "27d27d11-ef97-4faf-b5fb-c744bbdbcf9a"}]: dispatch 2024-01-24T15:36:40.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:39 smithi204 ceph-mon[39634]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "27d27d11-ef97-4faf-b5fb-c744bbdbcf9a"}]: dispatch 2024-01-24T15:36:40.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:39 smithi204 ceph-mon[39634]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "27d27d11-ef97-4faf-b5fb-c744bbdbcf9a"}]': finished 2024-01-24T15:36:40.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:39 smithi204 ceph-mon[39634]: osdmap e28: 5 total, 4 up, 5 in 2024-01-24T15:36:40.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:39 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-24T15:36:40.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:39 smithi160 ceph-mon[38982]: osdmap e27: 4 total, 4 up, 4 in 2024-01-24T15:36:40.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:39 smithi160 ceph-mon[38982]: pgmap v93: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-01-24T15:36:40.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:39 smithi160 ceph-mon[38982]: from='client.? 172.21.15.160:0/3995049693' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "27d27d11-ef97-4faf-b5fb-c744bbdbcf9a"}]: dispatch 2024-01-24T15:36:40.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:39 smithi160 ceph-mon[38982]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "27d27d11-ef97-4faf-b5fb-c744bbdbcf9a"}]: dispatch 2024-01-24T15:36:40.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:39 smithi160 ceph-mon[38982]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "27d27d11-ef97-4faf-b5fb-c744bbdbcf9a"}]': finished 2024-01-24T15:36:40.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:39 smithi160 ceph-mon[38982]: osdmap e28: 5 total, 4 up, 5 in 2024-01-24T15:36:40.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:39 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-24T15:36:41.182 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:40 smithi005 ceph-mon[35346]: from='client.? 172.21.15.160:0/2218588359' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:36:41.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:40 smithi005 ceph-mon[35346]: osdmap e29: 5 total, 4 up, 5 in 2024-01-24T15:36:41.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:40 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-24T15:36:41.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:40 smithi204 ceph-mon[39634]: from='client.? 172.21.15.160:0/2218588359' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:36:41.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:40 smithi204 ceph-mon[39634]: osdmap e29: 5 total, 4 up, 5 in 2024-01-24T15:36:41.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:40 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-24T15:36:41.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:40 smithi160 ceph-mon[38982]: from='client.? 172.21.15.160:0/2218588359' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:36:41.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:40 smithi160 ceph-mon[38982]: osdmap e29: 5 total, 4 up, 5 in 2024-01-24T15:36:41.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:40 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-24T15:36:42.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:41 smithi005 ceph-mon[35346]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-01-24T15:36:42.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:41 smithi204 ceph-mon[39634]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-01-24T15:36:42.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:41 smithi160 ceph-mon[38982]: pgmap v96: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-01-24T15:36:44.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:44 smithi160 ceph-mon[38982]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2024-01-24T15:36:44.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:44 smithi005 ceph-mon[35346]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2024-01-24T15:36:44.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:44 smithi204 ceph-mon[39634]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2024-01-24T15:36:46.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:46 smithi160 ceph-mon[38982]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-01-24T15:36:46.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:46 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-01-24T15:36:46.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:46 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:46.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:46 smithi005 ceph-mon[35346]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-01-24T15:36:46.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:46 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-01-24T15:36:46.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:46 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:46.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:46 smithi204 ceph-mon[39634]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-01-24T15:36:46.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:46 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-01-24T15:36:46.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:46 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:47.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:47 smithi005 ceph-mon[35346]: Deploying daemon osd.4 on smithi160 2024-01-24T15:36:47.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:47 smithi204 ceph-mon[39634]: Deploying daemon osd.4 on smithi160 2024-01-24T15:36:47.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:47 smithi160 ceph-mon[38982]: Deploying daemon osd.4 on smithi160 2024-01-24T15:36:48.432 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:48 smithi160 ceph-mon[38982]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-01-24T15:36:48.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:48 smithi005 ceph-mon[35346]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-01-24T15:36:48.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:48 smithi204 ceph-mon[39634]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-01-24T15:36:50.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:50 smithi160 ceph-mon[38982]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-01-24T15:36:50.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:50 smithi005 ceph-mon[35346]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-01-24T15:36:50.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:50 smithi204 ceph-mon[39634]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-01-24T15:36:52.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:51 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:52.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:51 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:52.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:51 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:36:52.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:51 smithi005 ceph-mon[35346]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-01-24T15:36:52.194 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:51 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:52.194 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:51 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:52.194 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:51 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:36:52.194 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:51 smithi160 ceph-mon[38982]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-01-24T15:36:52.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:51 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:52.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:51 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:52.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:51 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:36:52.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:51 smithi204 ceph-mon[39634]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-01-24T15:36:53.629 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:53.627+0000 7f9492000700 1 -- 172.21.15.160:0/2142404558 <== mgr.14150 v2:172.21.15.5:6800/1971309753 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9494061180 con 0x7f94740a0520 2024-01-24T15:36:53.630 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 4 on host 'smithi160' 2024-01-24T15:36:53.631 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:53.629+0000 7f949b600700 1 -- 172.21.15.160:0/2142404558 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f94740a0520 msgr2=0x7f94740a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:36:53.631 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:53.629+0000 7f949b600700 1 --2- 172.21.15.160:0/2142404558 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f94740a0520 0x7f94740a29e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9494101e30 tx=0x7f948400b040 comp rx=0 tx=0).stop 2024-01-24T15:36:53.632 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:53.629+0000 7f949b600700 1 -- 172.21.15.160:0/2142404558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9494101fd0 msgr2=0x7f9494073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:36:53.632 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:53.629+0000 7f949b600700 1 --2- 172.21.15.160:0/2142404558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9494101fd0 0x7f9494073130 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f947c000c00 tx=0x7f947c00fab0 comp rx=0 tx=0).stop 2024-01-24T15:36:53.632 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:53.629+0000 7f949b600700 1 -- 172.21.15.160:0/2142404558 shutdown_connections 2024-01-24T15:36:53.632 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:53.629+0000 7f949b600700 1 --2- 172.21.15.160:0/2142404558 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f94740a0520 0x7f94740a29e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:53.632 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:53.629+0000 7f949b600700 1 --2- 172.21.15.160:0/2142404558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9494102970 0x7f9494073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:53.632 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:53.629+0000 7f949b600700 1 --2- 172.21.15.160:0/2142404558 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f9494100dd0 0x7f9494074ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:53.632 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:53.629+0000 7f949b600700 1 --2- 172.21.15.160:0/2142404558 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9494101fd0 0x7f9494073130 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:53.632 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:53.629+0000 7f949b600700 1 -- 172.21.15.160:0/2142404558 >> 172.21.15.160:0/2142404558 conn(0x7f94940fc330 msgr2=0x7f94941055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:36:53.632 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:53.629+0000 7f949b600700 1 -- 172.21.15.160:0/2142404558 shutdown_connections 2024-01-24T15:36:53.632 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:36:53.629+0000 7f949b600700 1 -- 172.21.15.160:0/2142404558 wait complete. 2024-01-24T15:36:53.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:53.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:53.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:53.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:36:53.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:53.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:53 smithi160 ceph-mon[38982]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-01-24T15:36:53.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:53.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:53.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:36:53.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:53 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:53.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:53 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:53.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:53 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:53.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:53 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:36:53.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:53 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:53.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:53 smithi005 ceph-mon[35346]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-01-24T15:36:53.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:53 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:53.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:53 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:53.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:53 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:36:53.953 DEBUG:teuthology.orchestra.run.smithi160:osd.4> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.4.service 2024-01-24T15:36:53.957 INFO:tasks.cephadm:Deploying osd.5 on smithi204 with /dev/vg_nvme/lv_3... 2024-01-24T15:36:53.958 DEBUG:teuthology.orchestra.run.smithi204:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-01-24T15:36:53.974 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:53 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:53.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:53 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:53.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:53 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:53.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:53 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:36:53.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:53 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:53.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:53 smithi204 ceph-mon[39634]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-01-24T15:36:53.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:53 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:53.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:53 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:53.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:53 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:36:54.031 INFO:journalctl@ceph.osd.4.smithi160.stdout:-- Logs begin at Wed 2024-01-24 15:17:12 UTC. -- 2024-01-24T15:36:54.316 INFO:teuthology.orchestra.run.smithi204.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.c/config 2024-01-24T15:36:55.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:54 smithi160 ceph-mon[38982]: from='osd.4 [v2:172.21.15.160:6808/4260815326,v1:172.21.15.160:6809/4260815326]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-24T15:36:55.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:54 smithi160 ceph-mon[38982]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-24T15:36:55.258 INFO:journalctl@ceph.osd.4.smithi160.stdout:Jan 24 15:36:54 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-4[51813]: 2024-01-24T15:36:54.922+0000 7fa6af70b640 -1 osd.4 0 log_to_monitors true 2024-01-24T15:36:55.265 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:54 smithi204 ceph-mon[39634]: from='osd.4 [v2:172.21.15.160:6808/4260815326,v1:172.21.15.160:6809/4260815326]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-24T15:36:55.266 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:54 smithi204 ceph-mon[39634]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-24T15:36:55.432 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:54 smithi005 ceph-mon[35346]: from='osd.4 [v2:172.21.15.160:6808/4260815326,v1:172.21.15.160:6809/4260815326]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-24T15:36:55.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:54 smithi005 ceph-mon[35346]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-24T15:36:56.231 INFO:teuthology.orchestra.run.smithi204.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-01-24T15:36:56.232 INFO:teuthology.orchestra.run.smithi204.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-01-24T15:36:56.232 INFO:teuthology.orchestra.run.smithi204.stderr: stderr: 10+0 records in 2024-01-24T15:36:56.232 INFO:teuthology.orchestra.run.smithi204.stderr:10+0 records out 2024-01-24T15:36:56.232 INFO:teuthology.orchestra.run.smithi204.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0300726 s, 349 MB/s 2024-01-24T15:36:56.232 INFO:teuthology.orchestra.run.smithi204.stderr:--> Zapping successful for: 2024-01-24T15:36:56.257 INFO:journalctl@ceph.osd.4.smithi160.stdout:Jan 24 15:36:56 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-4[51813]: 2024-01-24T15:36:56.001+0000 7fa6a3200700 -1 osd.4 0 waiting for initial osdmap 2024-01-24T15:36:56.257 INFO:journalctl@ceph.osd.4.smithi160.stdout:Jan 24 15:36:56 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-4[51813]: 2024-01-24T15:36:56.011+0000 7fa69c200700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T15:36:56.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:55 smithi160 ceph-mon[38982]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-01-24T15:36:56.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:55 smithi160 ceph-mon[38982]: osdmap e30: 5 total, 4 up, 5 in 2024-01-24T15:36:56.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:55 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-24T15:36:56.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:55 smithi160 ceph-mon[38982]: from='osd.4 [v2:172.21.15.160:6808/4260815326,v1:172.21.15.160:6809/4260815326]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-01-24T15:36:56.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:55 smithi160 ceph-mon[38982]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-01-24T15:36:56.258 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:55 smithi160 ceph-mon[38982]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-01-24T15:36:56.268 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:55 smithi204 ceph-mon[39634]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-01-24T15:36:56.268 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:55 smithi204 ceph-mon[39634]: osdmap e30: 5 total, 4 up, 5 in 2024-01-24T15:36:56.268 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:55 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-24T15:36:56.268 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:55 smithi204 ceph-mon[39634]: from='osd.4 [v2:172.21.15.160:6808/4260815326,v1:172.21.15.160:6809/4260815326]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-01-24T15:36:56.268 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:55 smithi204 ceph-mon[39634]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-01-24T15:36:56.268 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:55 smithi204 ceph-mon[39634]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-01-24T15:36:56.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:55 smithi005 ceph-mon[35346]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-01-24T15:36:56.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:55 smithi005 ceph-mon[35346]: osdmap e30: 5 total, 4 up, 5 in 2024-01-24T15:36:56.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:55 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-24T15:36:56.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:55 smithi005 ceph-mon[35346]: from='osd.4 [v2:172.21.15.160:6808/4260815326,v1:172.21.15.160:6809/4260815326]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-01-24T15:36:56.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:55 smithi005 ceph-mon[35346]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-01-24T15:36:56.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:55 smithi005 ceph-mon[35346]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-01-24T15:36:56.730 DEBUG:teuthology.orchestra.run.smithi204:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph orch daemon add osd smithi204:vg_nvme/lv_3 2024-01-24T15:36:57.124 INFO:teuthology.orchestra.run.smithi204.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.c/config 2024-01-24T15:36:57.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:57 smithi204 ceph-mon[39634]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-01-24T15:36:57.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:57 smithi204 ceph-mon[39634]: osdmap e31: 5 total, 4 up, 5 in 2024-01-24T15:36:57.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:57 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-24T15:36:57.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:57 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-24T15:36:57.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:57 smithi204 ceph-mon[39634]: Detected new or changed devices on smithi160 2024-01-24T15:36:57.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:57 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:57.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:57 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:57.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:57 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:36:57.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:57 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:36:57.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:57 smithi204 ceph-mon[39634]: Adjusting osd_memory_target on smithi160 to 8635M 2024-01-24T15:36:57.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:57 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:57.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:57 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:57.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:57 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:36:57.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:57 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:57.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:57 smithi005 ceph-mon[35346]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-01-24T15:36:57.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:57 smithi005 ceph-mon[35346]: osdmap e31: 5 total, 4 up, 5 in 2024-01-24T15:36:57.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:57 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-24T15:36:57.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:57 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-24T15:36:57.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:57 smithi005 ceph-mon[35346]: Detected new or changed devices on smithi160 2024-01-24T15:36:57.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:57 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:57.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:57 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:57.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:57 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:36:57.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:57 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:36:57.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:57 smithi005 ceph-mon[35346]: Adjusting osd_memory_target on smithi160 to 8635M 2024-01-24T15:36:57.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:57 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:57.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:57 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:57.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:57 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:36:57.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:57 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:57.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:57 smithi160 ceph-mon[38982]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-01-24T15:36:57.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:57 smithi160 ceph-mon[38982]: osdmap e31: 5 total, 4 up, 5 in 2024-01-24T15:36:57.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:57 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-24T15:36:57.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:57 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-24T15:36:57.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:57 smithi160 ceph-mon[38982]: Detected new or changed devices on smithi160 2024-01-24T15:36:57.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:57 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:57.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:57 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:57.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:57 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:36:57.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:57 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:36:57.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:57 smithi160 ceph-mon[38982]: Adjusting osd_memory_target on smithi160 to 8635M 2024-01-24T15:36:57.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:57 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:57.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:57 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:57.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:57 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:36:57.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:57 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:36:58.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:58 smithi204 ceph-mon[39634]: purged_snaps scrub starts 2024-01-24T15:36:58.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:58 smithi204 ceph-mon[39634]: purged_snaps scrub ok 2024-01-24T15:36:58.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:58 smithi204 ceph-mon[39634]: osd.4 [v2:172.21.15.160:6808/4260815326,v1:172.21.15.160:6809/4260815326] boot 2024-01-24T15:36:58.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:58 smithi204 ceph-mon[39634]: osdmap e32: 5 total, 5 up, 5 in 2024-01-24T15:36:58.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:58 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-24T15:36:58.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:58 smithi204 ceph-mon[39634]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-01-24T15:36:58.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:58 smithi005 ceph-mon[35346]: purged_snaps scrub starts 2024-01-24T15:36:58.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:58 smithi005 ceph-mon[35346]: purged_snaps scrub ok 2024-01-24T15:36:58.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:58 smithi005 ceph-mon[35346]: osd.4 [v2:172.21.15.160:6808/4260815326,v1:172.21.15.160:6809/4260815326] boot 2024-01-24T15:36:58.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:58 smithi005 ceph-mon[35346]: osdmap e32: 5 total, 5 up, 5 in 2024-01-24T15:36:58.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:58 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-24T15:36:58.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:58 smithi005 ceph-mon[35346]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-01-24T15:36:58.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:58 smithi160 ceph-mon[38982]: purged_snaps scrub starts 2024-01-24T15:36:58.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:58 smithi160 ceph-mon[38982]: purged_snaps scrub ok 2024-01-24T15:36:58.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:58 smithi160 ceph-mon[38982]: osd.4 [v2:172.21.15.160:6808/4260815326,v1:172.21.15.160:6809/4260815326] boot 2024-01-24T15:36:58.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:58 smithi160 ceph-mon[38982]: osdmap e32: 5 total, 5 up, 5 in 2024-01-24T15:36:58.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:58 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-24T15:36:58.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:58 smithi160 ceph-mon[38982]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-01-24T15:36:58.597 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.595+0000 7f5b09000700 1 -- 172.21.15.204:0/2388697625 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b04101fd0 msgr2=0x7f5b04102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:36:58.598 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.595+0000 7f5b09000700 1 --2- 172.21.15.204:0/2388697625 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b04101fd0 0x7f5b04102430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5aec009990 tx=0x7f5aec009ca0 comp rx=0 tx=0).stop 2024-01-24T15:36:58.598 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.595+0000 7f5b09000700 1 -- 172.21.15.204:0/2388697625 shutdown_connections 2024-01-24T15:36:58.598 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.595+0000 7f5b09000700 1 --2- 172.21.15.204:0/2388697625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b04102970 0x7f5b04109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:58.598 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.595+0000 7f5b09000700 1 --2- 172.21.15.204:0/2388697625 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b04100dd0 0x7f5b041011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:58.598 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.595+0000 7f5b09000700 1 --2- 172.21.15.204:0/2388697625 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b04101fd0 0x7f5b04102430 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:58.598 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.595+0000 7f5b09000700 1 -- 172.21.15.204:0/2388697625 >> 172.21.15.204:0/2388697625 conn(0x7f5b040fc330 msgr2=0x7f5b040fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:36:58.598 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.596+0000 7f5b09000700 1 -- 172.21.15.204:0/2388697625 shutdown_connections 2024-01-24T15:36:58.598 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.596+0000 7f5b09000700 1 -- 172.21.15.204:0/2388697625 wait complete. 2024-01-24T15:36:58.599 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.597+0000 7f5b09000700 1 Processor -- start 2024-01-24T15:36:58.599 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.597+0000 7f5b09000700 1 -- start start 2024-01-24T15:36:58.600 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.598+0000 7f5b09000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b04100dd0 0x7f5b04074ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:36:58.600 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.598+0000 7f5b09000700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b04101fd0 0x7f5b04073130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:36:58.600 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.598+0000 7f5b09000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b04102970 0x7f5b04073670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:36:58.600 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.598+0000 7f5b09000700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b04073df0 con 0x7f5b04102970 2024-01-24T15:36:58.600 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.598+0000 7f5b09000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b04073f60 con 0x7f5b04100dd0 2024-01-24T15:36:58.601 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.598+0000 7f5b09000700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b041a0a50 con 0x7f5b04101fd0 2024-01-24T15:36:58.601 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.598+0000 7f5b01400700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b04101fd0 0x7f5b04073130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:36:58.601 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.598+0000 7f5b01400700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b04101fd0 0x7f5b04073130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:41002/0 (socket says 172.21.15.204:41002) 2024-01-24T15:36:58.601 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.598+0000 7f5b01400700 1 -- 172.21.15.204:0/591413564 learned_addr learned my addr 172.21.15.204:0/591413564 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-01-24T15:36:58.601 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.598+0000 7f5b01e00700 1 --2- 172.21.15.204:0/591413564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b04100dd0 0x7f5b04074ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:36:58.601 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.598+0000 7f5b02800700 1 --2- 172.21.15.204:0/591413564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b04102970 0x7f5b04073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:36:58.601 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.599+0000 7f5b01400700 1 -- 172.21.15.204:0/591413564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b04100dd0 msgr2=0x7f5b04074ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:36:58.601 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.599+0000 7f5b01400700 1 --2- 172.21.15.204:0/591413564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b04100dd0 0x7f5b04074ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:58.601 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.599+0000 7f5b01400700 1 -- 172.21.15.204:0/591413564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b04102970 msgr2=0x7f5b04073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:36:58.601 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.599+0000 7f5b01400700 1 --2- 172.21.15.204:0/591413564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b04102970 0x7f5b04073670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:36:58.601 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.599+0000 7f5b01400700 1 -- 172.21.15.204:0/591413564 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec0095f0 con 0x7f5b04101fd0 2024-01-24T15:36:58.601 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.599+0000 7f5b01e00700 1 --2- 172.21.15.204:0/591413564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b04100dd0 0x7f5b04074ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T15:36:58.601 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.599+0000 7f5b01400700 1 --2- 172.21.15.204:0/591413564 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b04101fd0 0x7f5b04073130 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5aec004360 tx=0x7f5aec00b9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:36:58.602 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.599+0000 7f5afaa00700 1 -- 172.21.15.204:0/591413564 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec01d070 con 0x7f5b04101fd0 2024-01-24T15:36:58.602 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.599+0000 7f5afaa00700 1 -- 172.21.15.204:0/591413564 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5aec00bed0 con 0x7f5b04101fd0 2024-01-24T15:36:58.602 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.599+0000 7f5b09000700 1 -- 172.21.15.204:0/591413564 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b041a0cd0 con 0x7f5b04101fd0 2024-01-24T15:36:58.602 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.599+0000 7f5afaa00700 1 -- 172.21.15.204:0/591413564 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec022d80 con 0x7f5b04101fd0 2024-01-24T15:36:58.602 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.599+0000 7f5b09000700 1 -- 172.21.15.204:0/591413564 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b041a1140 con 0x7f5b04101fd0 2024-01-24T15:36:58.603 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.600+0000 7f5b09000700 1 -- 172.21.15.204:0/591413564 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b04108470 con 0x7f5b04101fd0 2024-01-24T15:36:58.603 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.602+0000 7f5afaa00700 1 -- 172.21.15.204:0/591413564 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f5aec022470 con 0x7f5b04101fd0 2024-01-24T15:36:58.605 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.603+0000 7f5afaa00700 1 --2- 172.21.15.204:0/591413564 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5ae40a05a0 0x7f5ae40a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:36:58.605 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.604+0000 7f5afaa00700 1 -- 172.21.15.204:0/591413564 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f5aec0cc0f0 con 0x7f5b04101fd0 2024-01-24T15:36:58.607 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.604+0000 7f5b01e00700 1 --2- 172.21.15.204:0/591413564 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5ae40a05a0 0x7f5ae40a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:36:58.607 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.605+0000 7f5b01e00700 1 --2- 172.21.15.204:0/591413564 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5ae40a05a0 0x7f5ae40a2a60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5b04101e30 tx=0x7f5af4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:36:58.608 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.607+0000 7f5afaa00700 1 -- 172.21.15.204:0/591413564 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f5aec096cf0 con 0x7f5b04101fd0 2024-01-24T15:36:58.814 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:36:58.812+0000 7f5b09000700 1 -- 172.21.15.204:0/591413564 --> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi204:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b04061180 con 0x7f5ae40a05a0 2024-01-24T15:36:59.419 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:59 smithi204 ceph-mon[39634]: osdmap e33: 5 total, 5 up, 5 in 2024-01-24T15:36:59.419 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:59 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:36:59.419 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:59 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:36:59.419 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:36:59 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:59.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:59 smithi005 ceph-mon[35346]: osdmap e33: 5 total, 5 up, 5 in 2024-01-24T15:36:59.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:59 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:36:59.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:59 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:36:59.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:36:59 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:36:59.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:59 smithi160 ceph-mon[38982]: osdmap e33: 5 total, 5 up, 5 in 2024-01-24T15:36:59.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:59 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:36:59.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:59 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:36:59.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:36:59 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:00.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:00 smithi204 ceph-mon[39634]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi204:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:37:00.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:00 smithi204 ceph-mon[39634]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:00.432 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:00 smithi005 ceph-mon[35346]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi204:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:37:00.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:00 smithi005 ceph-mon[35346]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:00.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:00 smithi160 ceph-mon[38982]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi204:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:37:00.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:00 smithi160 ceph-mon[38982]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:02.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:02 smithi160 ceph-mon[38982]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:02.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:02 smithi160 ceph-mon[38982]: from='client.? 172.21.15.204:0/2167831049' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12425c52-d7ae-46f9-a949-c089587b3ffd"}]: dispatch 2024-01-24T15:37:02.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:02 smithi160 ceph-mon[38982]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12425c52-d7ae-46f9-a949-c089587b3ffd"}]: dispatch 2024-01-24T15:37:02.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:02 smithi160 ceph-mon[38982]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12425c52-d7ae-46f9-a949-c089587b3ffd"}]': finished 2024-01-24T15:37:02.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:02 smithi160 ceph-mon[38982]: osdmap e34: 6 total, 5 up, 6 in 2024-01-24T15:37:02.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:02 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-24T15:37:02.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:02 smithi160 ceph-mon[38982]: from='client.? 172.21.15.204:0/599465928' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:37:02.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:02 smithi005 ceph-mon[35346]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:02.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:02 smithi005 ceph-mon[35346]: from='client.? 172.21.15.204:0/2167831049' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12425c52-d7ae-46f9-a949-c089587b3ffd"}]: dispatch 2024-01-24T15:37:02.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:02 smithi005 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12425c52-d7ae-46f9-a949-c089587b3ffd"}]: dispatch 2024-01-24T15:37:02.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:02 smithi005 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12425c52-d7ae-46f9-a949-c089587b3ffd"}]': finished 2024-01-24T15:37:02.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:02 smithi005 ceph-mon[35346]: osdmap e34: 6 total, 5 up, 6 in 2024-01-24T15:37:02.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:02 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-24T15:37:02.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:02 smithi005 ceph-mon[35346]: from='client.? 172.21.15.204:0/599465928' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:37:02.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:02 smithi204 ceph-mon[39634]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:02.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:02 smithi204 ceph-mon[39634]: from='client.? 172.21.15.204:0/2167831049' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12425c52-d7ae-46f9-a949-c089587b3ffd"}]: dispatch 2024-01-24T15:37:02.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:02 smithi204 ceph-mon[39634]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12425c52-d7ae-46f9-a949-c089587b3ffd"}]: dispatch 2024-01-24T15:37:02.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:02 smithi204 ceph-mon[39634]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12425c52-d7ae-46f9-a949-c089587b3ffd"}]': finished 2024-01-24T15:37:02.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:02 smithi204 ceph-mon[39634]: osdmap e34: 6 total, 5 up, 6 in 2024-01-24T15:37:02.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:02 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-24T15:37:02.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:02 smithi204 ceph-mon[39634]: from='client.? 172.21.15.204:0/599465928' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:37:04.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:04 smithi160 ceph-mon[38982]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:04.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:04 smithi005 ceph-mon[35346]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:04.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:04 smithi204 ceph-mon[39634]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:06.654 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:06 smithi204 ceph-mon[39634]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:06.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:06 smithi005 ceph-mon[35346]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:06.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:06 smithi160 ceph-mon[38982]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:08.337 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:08 smithi204 ceph-mon[39634]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:08.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:08 smithi005 ceph-mon[35346]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:08.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:08 smithi160 ceph-mon[38982]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:09.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:09 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-01-24T15:37:09.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:09 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:09.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:09 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-01-24T15:37:09.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:09 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:09.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:09 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-01-24T15:37:09.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:09 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:10.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:10 smithi204 ceph-mon[39634]: Deploying daemon osd.5 on smithi204 2024-01-24T15:37:10.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:10 smithi204 ceph-mon[39634]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:10.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:10 smithi005 ceph-mon[35346]: Deploying daemon osd.5 on smithi204 2024-01-24T15:37:10.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:10 smithi005 ceph-mon[35346]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:10.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:10 smithi160 ceph-mon[38982]: Deploying daemon osd.5 on smithi204 2024-01-24T15:37:10.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:10 smithi160 ceph-mon[38982]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:12.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:12 smithi005 ceph-mon[35346]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:12.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:12 smithi204 ceph-mon[39634]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:12.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:12 smithi160 ceph-mon[38982]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:14.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:14 smithi005 ceph-mon[35346]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:14.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:14 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:14.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:14 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:14.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:14 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:37:14.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:14 smithi204 ceph-mon[39634]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:14.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:14 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:14.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:14 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:14.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:14 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:37:14.759 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:14 smithi160 ceph-mon[38982]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:14.759 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:14 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:14.759 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:14 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:14.759 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:14 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:37:16.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:16 smithi204 ceph-mon[39634]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:16.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:16 smithi005 ceph-mon[35346]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:16.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:16 smithi160 ceph-mon[38982]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:17.436 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:37:17.434+0000 7f5afaa00700 1 -- 172.21.15.204:0/591413564 <== mgr.14150 v2:172.21.15.5:6800/1971309753 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5b04061180 con 0x7f5ae40a05a0 2024-01-24T15:37:17.436 INFO:teuthology.orchestra.run.smithi204.stdout:Created osd(s) 5 on host 'smithi204' 2024-01-24T15:37:17.439 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:37:17.437+0000 7f5b09000700 1 -- 172.21.15.204:0/591413564 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5ae40a05a0 msgr2=0x7f5ae40a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:37:17.439 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:37:17.437+0000 7f5b09000700 1 --2- 172.21.15.204:0/591413564 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5ae40a05a0 0x7f5ae40a2a60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5b04101e30 tx=0x7f5af4009260 comp rx=0 tx=0).stop 2024-01-24T15:37:17.439 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:37:17.437+0000 7f5b09000700 1 -- 172.21.15.204:0/591413564 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b04101fd0 msgr2=0x7f5b04073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:37:17.439 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:37:17.437+0000 7f5b09000700 1 --2- 172.21.15.204:0/591413564 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b04101fd0 0x7f5b04073130 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5aec004360 tx=0x7f5aec00b9c0 comp rx=0 tx=0).stop 2024-01-24T15:37:17.439 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:37:17.437+0000 7f5b09000700 1 -- 172.21.15.204:0/591413564 shutdown_connections 2024-01-24T15:37:17.439 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:37:17.437+0000 7f5b09000700 1 --2- 172.21.15.204:0/591413564 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5ae40a05a0 0x7f5ae40a2a60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:37:17.439 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:37:17.437+0000 7f5b09000700 1 --2- 172.21.15.204:0/591413564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5b04102970 0x7f5b04073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:37:17.439 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:37:17.437+0000 7f5b09000700 1 --2- 172.21.15.204:0/591413564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b04100dd0 0x7f5b04074ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:37:17.439 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:37:17.437+0000 7f5b09000700 1 --2- 172.21.15.204:0/591413564 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5b04101fd0 0x7f5b04073130 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:37:17.439 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:37:17.437+0000 7f5b09000700 1 -- 172.21.15.204:0/591413564 >> 172.21.15.204:0/591413564 conn(0x7f5b040fc330 msgr2=0x7f5b041055b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:37:17.439 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:37:17.437+0000 7f5b09000700 1 -- 172.21.15.204:0/591413564 shutdown_connections 2024-01-24T15:37:17.439 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:37:17.437+0000 7f5b09000700 1 -- 172.21.15.204:0/591413564 wait complete. 2024-01-24T15:37:17.469 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:17 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:17.469 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:17 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:17.469 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:17 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:17.469 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:17 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:37:17.469 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:17 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:17.469 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:17 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:17.469 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:17 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:17.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:17 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:17.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:17 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:17.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:17 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:17.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:17 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:37:17.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:17 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:17.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:17 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:17.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:17 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:17.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:17 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:17.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:17 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:17.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:17 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:17.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:17 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:37:17.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:17 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:17.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:17 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:17.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:17 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:17.960 DEBUG:teuthology.orchestra.run.smithi204:osd.5> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.5.service 2024-01-24T15:37:17.965 INFO:tasks.cephadm:Deploying osd.6 on smithi005 with /dev/vg_nvme/lv_2... 2024-01-24T15:37:17.966 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-01-24T15:37:18.061 INFO:journalctl@ceph.osd.5.smithi204.stdout:-- Logs begin at Wed 2024-01-24 15:17:05 UTC. -- 2024-01-24T15:37:18.225 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:37:18 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:37:18.089+0000 7f7f15117640 -1 osd.5 0 log_to_monitors true 2024-01-24T15:37:18.354 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.a/config 2024-01-24T15:37:18.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:18 smithi204 ceph-mon[39634]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:18.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:18 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:37:18.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:18 smithi204 ceph-mon[39634]: from='osd.5 [v2:172.21.15.204:6808/1024339043,v1:172.21.15.204:6809/1024339043]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-24T15:37:18.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:18 smithi160 ceph-mon[38982]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:18.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:18 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:37:18.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:18 smithi160 ceph-mon[38982]: from='osd.5 [v2:172.21.15.204:6808/1024339043,v1:172.21.15.204:6809/1024339043]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-24T15:37:18.831 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:18 smithi005 ceph-mon[35346]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:18.831 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:18 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:37:18.831 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:18 smithi005 ceph-mon[35346]: from='osd.5 [v2:172.21.15.204:6808/1024339043,v1:172.21.15.204:6809/1024339043]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-24T15:37:19.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:19 smithi204 ceph-mon[39634]: from='osd.5 [v2:172.21.15.204:6808/1024339043,v1:172.21.15.204:6809/1024339043]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-01-24T15:37:19.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:19 smithi204 ceph-mon[39634]: osdmap e35: 6 total, 5 up, 6 in 2024-01-24T15:37:19.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:19 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-24T15:37:19.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:19 smithi204 ceph-mon[39634]: from='osd.5 [v2:172.21.15.204:6808/1024339043,v1:172.21.15.204:6809/1024339043]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]: dispatch 2024-01-24T15:37:19.726 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:37:19 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:37:19.467+0000 7f7f08c00700 -1 osd.5 0 waiting for initial osdmap 2024-01-24T15:37:19.726 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:37:19 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:37:19.479+0000 7f7eff400700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T15:37:19.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:19 smithi160 ceph-mon[38982]: from='osd.5 [v2:172.21.15.204:6808/1024339043,v1:172.21.15.204:6809/1024339043]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-01-24T15:37:19.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:19 smithi160 ceph-mon[38982]: osdmap e35: 6 total, 5 up, 6 in 2024-01-24T15:37:19.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:19 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-24T15:37:19.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:19 smithi160 ceph-mon[38982]: from='osd.5 [v2:172.21.15.204:6808/1024339043,v1:172.21.15.204:6809/1024339043]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]: dispatch 2024-01-24T15:37:19.913 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-01-24T15:37:19.914 INFO:teuthology.orchestra.run.smithi005.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-01-24T15:37:19.914 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10+0 records in 2024-01-24T15:37:19.914 INFO:teuthology.orchestra.run.smithi005.stderr:10+0 records out 2024-01-24T15:37:19.914 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0306098 s, 343 MB/s 2024-01-24T15:37:19.914 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping successful for: 2024-01-24T15:37:19.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:19 smithi005 ceph-mon[35346]: from='osd.5 [v2:172.21.15.204:6808/1024339043,v1:172.21.15.204:6809/1024339043]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-01-24T15:37:19.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:19 smithi005 ceph-mon[35346]: osdmap e35: 6 total, 5 up, 6 in 2024-01-24T15:37:19.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:19 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-24T15:37:19.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:19 smithi005 ceph-mon[35346]: from='osd.5 [v2:172.21.15.204:6808/1024339043,v1:172.21.15.204:6809/1024339043]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]: dispatch 2024-01-24T15:37:20.285 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph orch daemon add osd smithi005:vg_nvme/lv_2 2024-01-24T15:37:20.649 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.a/config 2024-01-24T15:37:20.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:20 smithi005 ceph-mon[35346]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:20.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:20 smithi005 ceph-mon[35346]: from='osd.5 [v2:172.21.15.204:6808/1024339043,v1:172.21.15.204:6809/1024339043]' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]': finished 2024-01-24T15:37:20.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:20 smithi005 ceph-mon[35346]: osdmap e36: 6 total, 5 up, 6 in 2024-01-24T15:37:20.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:20 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-24T15:37:20.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:20 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-24T15:37:20.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:20 smithi204 ceph-mon[39634]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:20.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:20 smithi204 ceph-mon[39634]: from='osd.5 [v2:172.21.15.204:6808/1024339043,v1:172.21.15.204:6809/1024339043]' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]': finished 2024-01-24T15:37:20.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:20 smithi204 ceph-mon[39634]: osdmap e36: 6 total, 5 up, 6 in 2024-01-24T15:37:20.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:20 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-24T15:37:20.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:20 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-24T15:37:20.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:20 smithi160 ceph-mon[38982]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:20.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:20 smithi160 ceph-mon[38982]: from='osd.5 [v2:172.21.15.204:6808/1024339043,v1:172.21.15.204:6809/1024339043]' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]': finished 2024-01-24T15:37:20.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:20 smithi160 ceph-mon[38982]: osdmap e36: 6 total, 5 up, 6 in 2024-01-24T15:37:20.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:20 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-24T15:37:20.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:20 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-24T15:37:21.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:21 smithi204 ceph-mon[39634]: purged_snaps scrub starts 2024-01-24T15:37:21.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:21 smithi204 ceph-mon[39634]: purged_snaps scrub ok 2024-01-24T15:37:21.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:21 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-24T15:37:21.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:21 smithi204 ceph-mon[39634]: osd.5 [v2:172.21.15.204:6808/1024339043,v1:172.21.15.204:6809/1024339043] boot 2024-01-24T15:37:21.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:21 smithi204 ceph-mon[39634]: osdmap e37: 6 total, 6 up, 6 in 2024-01-24T15:37:21.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:21 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-24T15:37:21.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:21 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:21.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:21 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:21.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:21 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:37:21.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:21 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:37:21.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:21 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:21.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:21 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:21.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:21 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:37:21.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:21 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:21.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:21 smithi160 ceph-mon[38982]: purged_snaps scrub starts 2024-01-24T15:37:21.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:21 smithi160 ceph-mon[38982]: purged_snaps scrub ok 2024-01-24T15:37:21.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:21 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-24T15:37:21.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:21 smithi160 ceph-mon[38982]: osd.5 [v2:172.21.15.204:6808/1024339043,v1:172.21.15.204:6809/1024339043] boot 2024-01-24T15:37:21.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:21 smithi160 ceph-mon[38982]: osdmap e37: 6 total, 6 up, 6 in 2024-01-24T15:37:21.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:21 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-24T15:37:21.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:21 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:21.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:21 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:21.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:21 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:37:21.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:21 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:37:21.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:21 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:21.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:21 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:21.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:21 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:37:21.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:21 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.850+0000 7f4e16800700 1 -- 172.21.15.5:0/2790272697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e100737a0 msgr2=0x7f4e10073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:37:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.850+0000 7f4e16800700 1 --2- 172.21.15.5:0/2790272697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e100737a0 0x7f4e10073c20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4df8009990 tx=0x7f4df8009ca0 comp rx=0 tx=0).stop 2024-01-24T15:37:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.850+0000 7f4e16800700 1 -- 172.21.15.5:0/2790272697 shutdown_connections 2024-01-24T15:37:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.850+0000 7f4e16800700 1 --2- 172.21.15.5:0/2790272697 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e10108ca0 0x7f4e1010b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:37:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.850+0000 7f4e16800700 1 --2- 172.21.15.5:0/2790272697 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e10074d70 0x7f4e100731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:37:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.850+0000 7f4e16800700 1 --2- 172.21.15.5:0/2790272697 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e100737a0 0x7f4e10073c20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:37:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.850+0000 7f4e16800700 1 -- 172.21.15.5:0/2790272697 >> 172.21.15.5:0/2790272697 conn(0x7f4e100fc330 msgr2=0x7f4e100fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:37:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.850+0000 7f4e16800700 1 -- 172.21.15.5:0/2790272697 shutdown_connections 2024-01-24T15:37:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.850+0000 7f4e16800700 1 -- 172.21.15.5:0/2790272697 wait complete. 2024-01-24T15:37:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.851+0000 7f4e16800700 1 Processor -- start 2024-01-24T15:37:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.851+0000 7f4e16800700 1 -- start start 2024-01-24T15:37:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.851+0000 7f4e16800700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e100737a0 0x7f4e10198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:37:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.851+0000 7f4e16800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e10074d70 0x7f4e101990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:37:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.851+0000 7f4e16800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e10108ca0 0x7f4e101a0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:37:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.851+0000 7f4e16800700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e101a0720 con 0x7f4e10108ca0 2024-01-24T15:37:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.851+0000 7f4e16800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e101a0860 con 0x7f4e10074d70 2024-01-24T15:37:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.851+0000 7f4e16800700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e101a09f0 con 0x7f4e100737a0 2024-01-24T15:37:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.852+0000 7f4e0fe00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e10108ca0 0x7f4e101a0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:37:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.852+0000 7f4e0f400700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e100737a0 0x7f4e10198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:37:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.852+0000 7f4e0fe00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e10108ca0 0x7f4e101a0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44062/0 (socket says 172.21.15.5:44062) 2024-01-24T15:37:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.852+0000 7f4e0fe00700 1 -- 172.21.15.5:0/1896264388 learned_addr learned my addr 172.21.15.5:0/1896264388 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:37:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.852+0000 7f4e0f400700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e100737a0 0x7f4e10198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.5:48348/0 (socket says 172.21.15.5:48348) 2024-01-24T15:37:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.852+0000 7f4e0ea00700 1 --2- 172.21.15.5:0/1896264388 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e10074d70 0x7f4e101990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:37:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.852+0000 7f4e0fe00700 1 -- 172.21.15.5:0/1896264388 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e100737a0 msgr2=0x7f4e10198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:37:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.852+0000 7f4e0fe00700 1 --2- 172.21.15.5:0/1896264388 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e100737a0 0x7f4e10198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:37:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.852+0000 7f4e0fe00700 1 -- 172.21.15.5:0/1896264388 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e10074d70 msgr2=0x7f4e101990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:37:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.852+0000 7f4e0fe00700 1 --2- 172.21.15.5:0/1896264388 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e10074d70 0x7f4e101990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:37:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.852+0000 7f4e0fe00700 1 -- 172.21.15.5:0/1896264388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df80095f0 con 0x7f4e10108ca0 2024-01-24T15:37:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.852+0000 7f4e0f400700 1 --2- 172.21.15.5:0/1896264388 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e100737a0 0x7f4e10198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T15:37:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.852+0000 7f4e0fe00700 1 --2- 172.21.15.5:0/1896264388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e10108ca0 0x7f4e101a0150 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4e08007da0 tx=0x7f4e0800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:37:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.853+0000 7f4e07e00700 1 -- 172.21.15.5:0/1896264388 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0800ac50 con 0x7f4e10108ca0 2024-01-24T15:37:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.853+0000 7f4e07e00700 1 -- 172.21.15.5:0/1896264388 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e0800adb0 con 0x7f4e10108ca0 2024-01-24T15:37:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.853+0000 7f4e07e00700 1 -- 172.21.15.5:0/1896264388 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e080115e0 con 0x7f4e10108ca0 2024-01-24T15:37:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.853+0000 7f4e16800700 1 -- 172.21.15.5:0/1896264388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e101a0cd0 con 0x7f4e10108ca0 2024-01-24T15:37:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.853+0000 7f4e16800700 1 -- 172.21.15.5:0/1896264388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e101a1180 con 0x7f4e10108ca0 2024-01-24T15:37:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.854+0000 7f4e16800700 1 -- 172.21.15.5:0/1896264388 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e10107350 con 0x7f4e10108ca0 2024-01-24T15:37:21.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.856+0000 7f4e07e00700 1 -- 172.21.15.5:0/1896264388 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f4e08004ad0 con 0x7f4e10108ca0 2024-01-24T15:37:21.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.857+0000 7f4e07e00700 1 --2- 172.21.15.5:0/1896264388 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f4df00a05a0 0x7f4df00a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:37:21.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.857+0000 7f4e07e00700 1 -- 172.21.15.5:0/1896264388 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4562+0+0 (secure 0 0 0) 0x7f4e080cb120 con 0x7f4e10108ca0 2024-01-24T15:37:21.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.858+0000 7f4e0f400700 1 --2- 172.21.15.5:0/1896264388 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f4df00a05a0 0x7f4df00a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:37:21.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.858+0000 7f4e0f400700 1 --2- 172.21.15.5:0/1896264388 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f4df00a05a0 0x7f4df00a2a60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4e10075150 tx=0x7f4e00009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:37:21.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:21.860+0000 7f4e07e00700 1 -- 172.21.15.5:0/1896264388 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f4e08095ac0 con 0x7f4e10108ca0 2024-01-24T15:37:21.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:21 smithi005 ceph-mon[35346]: purged_snaps scrub starts 2024-01-24T15:37:21.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:21 smithi005 ceph-mon[35346]: purged_snaps scrub ok 2024-01-24T15:37:21.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:21 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-24T15:37:21.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:21 smithi005 ceph-mon[35346]: osd.5 [v2:172.21.15.204:6808/1024339043,v1:172.21.15.204:6809/1024339043] boot 2024-01-24T15:37:21.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:21 smithi005 ceph-mon[35346]: osdmap e37: 6 total, 6 up, 6 in 2024-01-24T15:37:21.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:21 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-24T15:37:21.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:21 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:21.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:21 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:21.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:21 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:37:21.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:21 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:37:21.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:21 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:21.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:21 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:21.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:21 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:37:21.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:21 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:22.080+0000 7f4e16800700 1 -- 172.21.15.5:0/1896264388 --> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e10061180 con 0x7f4df00a05a0 2024-01-24T15:37:22.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:22 smithi160 ceph-mon[38982]: Detected new or changed devices on smithi204 2024-01-24T15:37:22.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:22 smithi160 ceph-mon[38982]: Adjusting osd_memory_target on smithi204 to 8635M 2024-01-24T15:37:22.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:22 smithi160 ceph-mon[38982]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:22.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:22 smithi160 ceph-mon[38982]: osdmap e38: 6 total, 6 up, 6 in 2024-01-24T15:37:22.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:22 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:37:22.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:22 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:37:22.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:22 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:22.808 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:22 smithi005 ceph-mon[35346]: Detected new or changed devices on smithi204 2024-01-24T15:37:22.808 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:22 smithi005 ceph-mon[35346]: Adjusting osd_memory_target on smithi204 to 8635M 2024-01-24T15:37:22.808 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:22 smithi005 ceph-mon[35346]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:22.809 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:22 smithi005 ceph-mon[35346]: osdmap e38: 6 total, 6 up, 6 in 2024-01-24T15:37:22.809 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:22 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:37:22.809 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:22 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:37:22.809 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:22 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:22.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:22 smithi204 ceph-mon[39634]: Detected new or changed devices on smithi204 2024-01-24T15:37:22.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:22 smithi204 ceph-mon[39634]: Adjusting osd_memory_target on smithi204 to 8635M 2024-01-24T15:37:22.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:22 smithi204 ceph-mon[39634]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-01-24T15:37:22.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:22 smithi204 ceph-mon[39634]: osdmap e38: 6 total, 6 up, 6 in 2024-01-24T15:37:22.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:22 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:37:22.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:22 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:37:22.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:22 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:23.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:23 smithi005 ceph-mon[35346]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:37:23.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:23 smithi005 ceph-mon[35346]: osdmap e39: 6 total, 6 up, 6 in 2024-01-24T15:37:23.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:23 smithi005 ceph-mon[35346]: osdmap e40: 6 total, 6 up, 6 in 2024-01-24T15:37:23.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:23 smithi160 ceph-mon[38982]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:37:23.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:23 smithi160 ceph-mon[38982]: osdmap e39: 6 total, 6 up, 6 in 2024-01-24T15:37:23.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:23 smithi160 ceph-mon[38982]: osdmap e40: 6 total, 6 up, 6 in 2024-01-24T15:37:23.974 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:23 smithi204 ceph-mon[39634]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:37:23.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:23 smithi204 ceph-mon[39634]: osdmap e39: 6 total, 6 up, 6 in 2024-01-24T15:37:23.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:23 smithi204 ceph-mon[39634]: osdmap e40: 6 total, 6 up, 6 in 2024-01-24T15:37:24.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:24 smithi160 ceph-mon[38982]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-01-24T15:37:24.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:24 smithi160 ceph-mon[38982]: osdmap e41: 6 total, 6 up, 6 in 2024-01-24T15:37:24.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:24 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/690938715' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2dda7ced-0f36-4f9e-aa2c-3d2d03990ed7"}]: dispatch 2024-01-24T15:37:24.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:24 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/690938715' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2dda7ced-0f36-4f9e-aa2c-3d2d03990ed7"}]': finished 2024-01-24T15:37:24.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:24 smithi160 ceph-mon[38982]: osdmap e42: 7 total, 6 up, 7 in 2024-01-24T15:37:24.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:24 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-24T15:37:24.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:24 smithi005 ceph-mon[35346]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-01-24T15:37:24.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:24 smithi005 ceph-mon[35346]: osdmap e41: 6 total, 6 up, 6 in 2024-01-24T15:37:24.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:24 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/690938715' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2dda7ced-0f36-4f9e-aa2c-3d2d03990ed7"}]: dispatch 2024-01-24T15:37:24.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:24 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/690938715' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2dda7ced-0f36-4f9e-aa2c-3d2d03990ed7"}]': finished 2024-01-24T15:37:24.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:24 smithi005 ceph-mon[35346]: osdmap e42: 7 total, 6 up, 7 in 2024-01-24T15:37:24.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:24 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-24T15:37:24.980 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:24 smithi204 ceph-mon[39634]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-01-24T15:37:24.981 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:24 smithi204 ceph-mon[39634]: osdmap e41: 6 total, 6 up, 6 in 2024-01-24T15:37:24.981 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:24 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/690938715' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2dda7ced-0f36-4f9e-aa2c-3d2d03990ed7"}]: dispatch 2024-01-24T15:37:24.981 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:24 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/690938715' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2dda7ced-0f36-4f9e-aa2c-3d2d03990ed7"}]': finished 2024-01-24T15:37:24.981 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:24 smithi204 ceph-mon[39634]: osdmap e42: 7 total, 6 up, 7 in 2024-01-24T15:37:24.981 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:24 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-24T15:37:25.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:25 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/1570622001' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:37:25.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:25 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/1570622001' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:37:25.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:25 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/1570622001' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:37:26.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:26 smithi160 ceph-mon[38982]: pgmap v131: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 155 KiB/s, 0 objects/s recovering 2024-01-24T15:37:26.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:26 smithi005 ceph-mon[35346]: pgmap v131: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 155 KiB/s, 0 objects/s recovering 2024-01-24T15:37:26.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:26 smithi204 ceph-mon[39634]: pgmap v131: 1 pgs: 1 peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 155 KiB/s, 0 objects/s recovering 2024-01-24T15:37:28.580 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:28 smithi005 ceph-mon[35346]: pgmap v132: 1 pgs: 1 peering; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-01-24T15:37:28.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:28 smithi160 ceph-mon[38982]: pgmap v132: 1 pgs: 1 peering; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-01-24T15:37:28.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:28 smithi204 ceph-mon[39634]: pgmap v132: 1 pgs: 1 peering; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-01-24T15:37:30.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:30 smithi005 ceph-mon[35346]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-01-24T15:37:30.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:30 smithi204 ceph-mon[39634]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-01-24T15:37:31.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:30 smithi160 ceph-mon[38982]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-01-24T15:37:31.653 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:31 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-01-24T15:37:31.654 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:31 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:31.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:31 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-01-24T15:37:31.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:31 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:32.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:31 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-01-24T15:37:32.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:31 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:32.887 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:32 smithi005 ceph-mon[35346]: Deploying daemon osd.6 on smithi005 2024-01-24T15:37:32.888 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:32 smithi005 ceph-mon[35346]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-01-24T15:37:32.974 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:32 smithi204 ceph-mon[39634]: Deploying daemon osd.6 on smithi005 2024-01-24T15:37:32.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:32 smithi204 ceph-mon[39634]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-01-24T15:37:33.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:32 smithi160 ceph-mon[38982]: Deploying daemon osd.6 on smithi005 2024-01-24T15:37:33.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:32 smithi160 ceph-mon[38982]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-01-24T15:37:34.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:34 smithi005 ceph-mon[35346]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-01-24T15:37:34.974 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:34 smithi204 ceph-mon[39634]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-01-24T15:37:35.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:34 smithi160 ceph-mon[38982]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-01-24T15:37:36.763 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:36 smithi005 ceph-mon[35346]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-01-24T15:37:36.763 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:36 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:36.763 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:36 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:36.763 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:36 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:37:36.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:36 smithi204 ceph-mon[39634]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-01-24T15:37:36.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:36 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:36.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:36 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:36.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:36 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:37:37.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:36 smithi160 ceph-mon[38982]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-01-24T15:37:37.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:36 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:37.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:36 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:37.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:36 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:37:38.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:38.298+0000 7f4e07e00700 1 -- 172.21.15.5:0/1896264388 <== mgr.14150 v2:172.21.15.5:6800/1971309753 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4e10061180 con 0x7f4df00a05a0 2024-01-24T15:37:38.300 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 6 on host 'smithi005' 2024-01-24T15:37:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:38.300+0000 7f4e16800700 1 -- 172.21.15.5:0/1896264388 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f4df00a05a0 msgr2=0x7f4df00a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:37:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:38.300+0000 7f4e16800700 1 --2- 172.21.15.5:0/1896264388 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f4df00a05a0 0x7f4df00a2a60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4e10075150 tx=0x7f4e00009260 comp rx=0 tx=0).stop 2024-01-24T15:37:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:38.300+0000 7f4e16800700 1 -- 172.21.15.5:0/1896264388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e10108ca0 msgr2=0x7f4e101a0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:37:38.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:38.300+0000 7f4e16800700 1 --2- 172.21.15.5:0/1896264388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e10108ca0 0x7f4e101a0150 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4e08007da0 tx=0x7f4e0800a340 comp rx=0 tx=0).stop 2024-01-24T15:37:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:38.301+0000 7f4e16800700 1 -- 172.21.15.5:0/1896264388 shutdown_connections 2024-01-24T15:37:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:38.301+0000 7f4e16800700 1 --2- 172.21.15.5:0/1896264388 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f4df00a05a0 0x7f4df00a2a60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:37:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:38.301+0000 7f4e16800700 1 --2- 172.21.15.5:0/1896264388 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e10108ca0 0x7f4e101a0150 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:37:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:38.301+0000 7f4e16800700 1 --2- 172.21.15.5:0/1896264388 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4e100737a0 0x7f4e10198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:37:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:38.301+0000 7f4e16800700 1 --2- 172.21.15.5:0/1896264388 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e10074d70 0x7f4e101990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:37:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:38.301+0000 7f4e16800700 1 -- 172.21.15.5:0/1896264388 >> 172.21.15.5:0/1896264388 conn(0x7f4e100fc330 msgr2=0x7f4e100fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:37:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:38.301+0000 7f4e16800700 1 -- 172.21.15.5:0/1896264388 shutdown_connections 2024-01-24T15:37:38.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:37:38.301+0000 7f4e16800700 1 -- 172.21.15.5:0/1896264388 wait complete. 2024-01-24T15:37:38.686 DEBUG:teuthology.orchestra.run.smithi005:osd.6> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.6.service 2024-01-24T15:37:38.690 INFO:tasks.cephadm:Deploying osd.7 on smithi160 with /dev/vg_nvme/lv_2... 2024-01-24T15:37:38.690 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-01-24T15:37:38.757 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:38 smithi005 ceph-mon[35346]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-01-24T15:37:38.757 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:38 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:38.757 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:38 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:38.758 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:38 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:38.758 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:38 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:37:38.758 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:38 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:38.758 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:38 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:37:38.758 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:38 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:38.758 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:38 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:38.770 INFO:journalctl@ceph.osd.6.smithi005.stdout:-- Logs begin at Wed 2024-01-24 15:16:42 UTC. -- 2024-01-24T15:37:38.775 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:38 smithi160 ceph-mon[38982]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-01-24T15:37:38.775 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:38 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:38.775 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:38 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:38.776 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:38 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:38.776 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:38 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:37:38.776 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:38 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:38.776 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:38 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:37:38.776 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:38 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:38.776 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:38 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:38.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:38 smithi204 ceph-mon[39634]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-01-24T15:37:38.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:38 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:38.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:38 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:38.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:38 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:38.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:38 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:37:38.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:38 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:38.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:38 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:37:38.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:38 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:38.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:38 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:39.067 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.b/config 2024-01-24T15:37:39.860 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:37:39 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:37:39.801+0000 7effefbeb640 -1 osd.6 0 log_to_monitors true 2024-01-24T15:37:40.568 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-01-24T15:37:40.568 INFO:teuthology.orchestra.run.smithi160.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-01-24T15:37:40.568 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10+0 records in 2024-01-24T15:37:40.568 INFO:teuthology.orchestra.run.smithi160.stderr:10+0 records out 2024-01-24T15:37:40.568 INFO:teuthology.orchestra.run.smithi160.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0541125 s, 194 MB/s 2024-01-24T15:37:40.568 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping successful for: 2024-01-24T15:37:40.893 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:40 smithi160 ceph-mon[38982]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-01-24T15:37:40.893 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:40 smithi160 ceph-mon[38982]: from='osd.6 [v2:172.21.15.5:6818/754402627,v1:172.21.15.5:6819/754402627]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-24T15:37:40.893 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:40 smithi160 ceph-mon[38982]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-24T15:37:40.923 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph orch daemon add osd smithi160:vg_nvme/lv_2 2024-01-24T15:37:40.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:40 smithi005 ceph-mon[35346]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-01-24T15:37:40.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:40 smithi005 ceph-mon[35346]: from='osd.6 [v2:172.21.15.5:6818/754402627,v1:172.21.15.5:6819/754402627]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-24T15:37:40.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:40 smithi005 ceph-mon[35346]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-24T15:37:40.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:40 smithi204 ceph-mon[39634]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-01-24T15:37:40.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:40 smithi204 ceph-mon[39634]: from='osd.6 [v2:172.21.15.5:6818/754402627,v1:172.21.15.5:6819/754402627]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-24T15:37:40.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:40 smithi204 ceph-mon[39634]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-24T15:37:41.274 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.b/config 2024-01-24T15:37:41.659 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:41 smithi160 ceph-mon[38982]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-01-24T15:37:41.659 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:41 smithi160 ceph-mon[38982]: osdmap e43: 7 total, 6 up, 7 in 2024-01-24T15:37:41.659 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:41 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-24T15:37:41.660 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:41 smithi160 ceph-mon[38982]: from='osd.6 [v2:172.21.15.5:6818/754402627,v1:172.21.15.5:6819/754402627]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-01-24T15:37:41.660 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:41 smithi160 ceph-mon[38982]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-01-24T15:37:41.660 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:41 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:41.660 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:41 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:41.660 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:41 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:37:41.660 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:41 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:37:41.660 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:41 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:37:41.660 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:41 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:41.660 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:41 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:41.660 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:41 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:37:41.660 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:41 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:41.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:37:41 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:37:41.550+0000 7effe3800700 -1 osd.6 0 waiting for initial osdmap 2024-01-24T15:37:41.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:37:41 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:37:41.564+0000 7effde600700 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T15:37:41.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:41 smithi005 ceph-mon[35346]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-01-24T15:37:41.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:41 smithi005 ceph-mon[35346]: osdmap e43: 7 total, 6 up, 7 in 2024-01-24T15:37:41.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:41 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-24T15:37:41.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:41 smithi005 ceph-mon[35346]: from='osd.6 [v2:172.21.15.5:6818/754402627,v1:172.21.15.5:6819/754402627]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-01-24T15:37:41.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:41 smithi005 ceph-mon[35346]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-01-24T15:37:41.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:41 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:41.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:41 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:41.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:41 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:37:41.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:41 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:37:41.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:41 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:37:41.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:41 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:41.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:41 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:41.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:41 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:37:41.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:41 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:41.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:41 smithi204 ceph-mon[39634]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-01-24T15:37:41.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:41 smithi204 ceph-mon[39634]: osdmap e43: 7 total, 6 up, 7 in 2024-01-24T15:37:41.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:41 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-24T15:37:41.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:41 smithi204 ceph-mon[39634]: from='osd.6 [v2:172.21.15.5:6818/754402627,v1:172.21.15.5:6819/754402627]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-01-24T15:37:41.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:41 smithi204 ceph-mon[39634]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-01-24T15:37:41.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:41 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:41.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:41 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:41.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:41 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:37:41.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:41 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:37:41.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:41 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:37:41.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:41 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:41.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:41 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:41.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:41 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:37:41.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:41 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:42.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.264+0000 7fa91cc00700 1 -- 172.21.15.160:0/3282142724 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa918100dd0 msgr2=0x7fa9181011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:37:42.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.264+0000 7fa91cc00700 1 --2- 172.21.15.160:0/3282142724 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa918100dd0 0x7fa9181011f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa9080099c0 tx=0x7fa908009cd0 comp rx=0 tx=0).stop 2024-01-24T15:37:42.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.264+0000 7fa91cc00700 1 -- 172.21.15.160:0/3282142724 shutdown_connections 2024-01-24T15:37:42.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.264+0000 7fa91cc00700 1 --2- 172.21.15.160:0/3282142724 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa918102970 0x7fa918109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:37:42.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.264+0000 7fa91cc00700 1 --2- 172.21.15.160:0/3282142724 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa918100dd0 0x7fa9181011f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:37:42.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.264+0000 7fa91cc00700 1 --2- 172.21.15.160:0/3282142724 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa918101fd0 0x7fa918102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:37:42.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.264+0000 7fa91cc00700 1 -- 172.21.15.160:0/3282142724 >> 172.21.15.160:0/3282142724 conn(0x7fa9180fc330 msgr2=0x7fa9180fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:37:42.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.264+0000 7fa91cc00700 1 -- 172.21.15.160:0/3282142724 shutdown_connections 2024-01-24T15:37:42.267 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.264+0000 7fa91cc00700 1 -- 172.21.15.160:0/3282142724 wait complete. 2024-01-24T15:37:42.269 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.265+0000 7fa91cc00700 1 Processor -- start 2024-01-24T15:37:42.269 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.265+0000 7fa91cc00700 1 -- start start 2024-01-24T15:37:42.269 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.265+0000 7fa91cc00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa918100dd0 0x7fa918196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:37:42.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.265+0000 7fa91cc00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa918101fd0 0x7fa918196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:37:42.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.265+0000 7fa91cc00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa918102970 0x7fa91819dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:37:42.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.265+0000 7fa91cc00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91819e5a0 con 0x7fa918100dd0 2024-01-24T15:37:42.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.265+0000 7fa91cc00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91819e6e0 con 0x7fa918101fd0 2024-01-24T15:37:42.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.265+0000 7fa91cc00700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91819e870 con 0x7fa918102970 2024-01-24T15:37:42.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.265+0000 7fa915400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa918101fd0 0x7fa918196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:37:42.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.265+0000 7fa915400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa918101fd0 0x7fa918196f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:53956/0 (socket says 172.21.15.160:53956) 2024-01-24T15:37:42.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.265+0000 7fa915400700 1 -- 172.21.15.160:0/410787958 learned_addr learned my addr 172.21.15.160:0/410787958 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-01-24T15:37:42.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.266+0000 7fa916800700 1 --2- 172.21.15.160:0/410787958 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa918102970 0x7fa91819dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:37:42.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.266+0000 7fa915e00700 1 --2- 172.21.15.160:0/410787958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa918100dd0 0x7fa918196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:37:42.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.266+0000 7fa915400700 1 -- 172.21.15.160:0/410787958 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa918102970 msgr2=0x7fa91819dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:37:42.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.266+0000 7fa915400700 1 --2- 172.21.15.160:0/410787958 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa918102970 0x7fa91819dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:37:42.270 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.266+0000 7fa915400700 1 -- 172.21.15.160:0/410787958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa918100dd0 msgr2=0x7fa918196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:37:42.271 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.266+0000 7fa915400700 1 --2- 172.21.15.160:0/410787958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa918100dd0 0x7fa918196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:37:42.271 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.266+0000 7fa915400700 1 -- 172.21.15.160:0/410787958 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9080095f0 con 0x7fa918101fd0 2024-01-24T15:37:42.271 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.266+0000 7fa916800700 1 --2- 172.21.15.160:0/410787958 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa918102970 0x7fa91819dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T15:37:42.271 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.266+0000 7fa915e00700 1 --2- 172.21.15.160:0/410787958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa918100dd0 0x7fa918196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T15:37:42.271 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.266+0000 7fa915400700 1 --2- 172.21.15.160:0/410787958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa918101fd0 0x7fa918196f50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa90000d950 tx=0x7fa90000dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:37:42.271 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.266+0000 7fa90ea00700 1 -- 172.21.15.160:0/410787958 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa900009b40 con 0x7fa918101fd0 2024-01-24T15:37:42.271 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.266+0000 7fa90ea00700 1 -- 172.21.15.160:0/410787958 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa900009ca0 con 0x7fa918101fd0 2024-01-24T15:37:42.271 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.266+0000 7fa90ea00700 1 -- 172.21.15.160:0/410787958 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa900010ea0 con 0x7fa918101fd0 2024-01-24T15:37:42.271 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.266+0000 7fa91cc00700 1 -- 172.21.15.160:0/410787958 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa91819eb50 con 0x7fa918101fd0 2024-01-24T15:37:42.271 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.267+0000 7fa91cc00700 1 -- 172.21.15.160:0/410787958 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91819f000 con 0x7fa918101fd0 2024-01-24T15:37:42.271 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.268+0000 7fa91cc00700 1 -- 172.21.15.160:0/410787958 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa91810c4d0 con 0x7fa918101fd0 2024-01-24T15:37:42.272 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.270+0000 7fa90ea00700 1 -- 172.21.15.160:0/410787958 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7fa900010460 con 0x7fa918101fd0 2024-01-24T15:37:42.273 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.271+0000 7fa90ea00700 1 --2- 172.21.15.160:0/410787958 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fa8f80a05a0 0x7fa8f80a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:37:42.273 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.271+0000 7fa90ea00700 1 -- 172.21.15.160:0/410787958 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4685+0+0 (secure 0 0 0) 0x7fa9000cab30 con 0x7fa918101fd0 2024-01-24T15:37:42.273 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.271+0000 7fa915e00700 1 --2- 172.21.15.160:0/410787958 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fa8f80a05a0 0x7fa8f80a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:37:42.274 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.272+0000 7fa915e00700 1 --2- 172.21.15.160:0/410787958 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fa8f80a05a0 0x7fa8f80a2a60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa908009990 tx=0x7fa90801a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:37:42.277 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.275+0000 7fa90ea00700 1 -- 172.21.15.160:0/410787958 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7fa900095460 con 0x7fa918101fd0 2024-01-24T15:37:42.485 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:42.483+0000 7fa91cc00700 1 -- 172.21.15.160:0/410787958 --> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa918061180 con 0x7fa8f80a05a0 2024-01-24T15:37:42.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:42 smithi005 ceph-mon[35346]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-01-24T15:37:42.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:42 smithi005 ceph-mon[35346]: Detected new or changed devices on smithi005 2024-01-24T15:37:42.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:42 smithi005 ceph-mon[35346]: Adjusting osd_memory_target on smithi005 to 5758M 2024-01-24T15:37:42.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:42 smithi005 ceph-mon[35346]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-01-24T15:37:42.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:42 smithi005 ceph-mon[35346]: osdmap e44: 7 total, 6 up, 7 in 2024-01-24T15:37:42.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:42 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-24T15:37:42.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:42 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-24T15:37:42.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:42 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:37:42.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:42 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:37:42.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:42 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:42.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:42 smithi204 ceph-mon[39634]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-01-24T15:37:42.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:42 smithi204 ceph-mon[39634]: Detected new or changed devices on smithi005 2024-01-24T15:37:42.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:42 smithi204 ceph-mon[39634]: Adjusting osd_memory_target on smithi005 to 5758M 2024-01-24T15:37:42.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:42 smithi204 ceph-mon[39634]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-01-24T15:37:42.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:42 smithi204 ceph-mon[39634]: osdmap e44: 7 total, 6 up, 7 in 2024-01-24T15:37:42.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:42 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-24T15:37:42.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:42 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-24T15:37:42.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:42 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:37:42.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:42 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:37:42.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:42 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:43.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:42 smithi160 ceph-mon[38982]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-01-24T15:37:43.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:42 smithi160 ceph-mon[38982]: Detected new or changed devices on smithi005 2024-01-24T15:37:43.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:42 smithi160 ceph-mon[38982]: Adjusting osd_memory_target on smithi005 to 5758M 2024-01-24T15:37:43.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:42 smithi160 ceph-mon[38982]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-01-24T15:37:43.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:42 smithi160 ceph-mon[38982]: osdmap e44: 7 total, 6 up, 7 in 2024-01-24T15:37:43.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:42 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-24T15:37:43.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:42 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-24T15:37:43.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:42 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:37:43.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:42 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:37:43.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:42 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:43.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:43 smithi160 ceph-mon[38982]: purged_snaps scrub starts 2024-01-24T15:37:43.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:43 smithi160 ceph-mon[38982]: purged_snaps scrub ok 2024-01-24T15:37:43.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:43 smithi160 ceph-mon[38982]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:37:43.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:43 smithi160 ceph-mon[38982]: osd.6 [v2:172.21.15.5:6818/754402627,v1:172.21.15.5:6819/754402627] boot 2024-01-24T15:37:43.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:43 smithi160 ceph-mon[38982]: osdmap e45: 7 total, 7 up, 7 in 2024-01-24T15:37:43.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:43 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-24T15:37:43.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:43 smithi005 ceph-mon[35346]: purged_snaps scrub starts 2024-01-24T15:37:43.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:43 smithi005 ceph-mon[35346]: purged_snaps scrub ok 2024-01-24T15:37:43.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:43 smithi005 ceph-mon[35346]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:37:43.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:43 smithi005 ceph-mon[35346]: osd.6 [v2:172.21.15.5:6818/754402627,v1:172.21.15.5:6819/754402627] boot 2024-01-24T15:37:43.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:43 smithi005 ceph-mon[35346]: osdmap e45: 7 total, 7 up, 7 in 2024-01-24T15:37:43.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:43 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-24T15:37:43.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:43 smithi204 ceph-mon[39634]: purged_snaps scrub starts 2024-01-24T15:37:43.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:43 smithi204 ceph-mon[39634]: purged_snaps scrub ok 2024-01-24T15:37:43.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:43 smithi204 ceph-mon[39634]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:37:43.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:43 smithi204 ceph-mon[39634]: osd.6 [v2:172.21.15.5:6818/754402627,v1:172.21.15.5:6819/754402627] boot 2024-01-24T15:37:43.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:43 smithi204 ceph-mon[39634]: osdmap e45: 7 total, 7 up, 7 in 2024-01-24T15:37:43.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:43 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-24T15:37:44.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:44 smithi005 ceph-mon[35346]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:37:44.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:44 smithi005 ceph-mon[35346]: osdmap e46: 7 total, 7 up, 7 in 2024-01-24T15:37:44.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:44 smithi204 ceph-mon[39634]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:37:44.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:44 smithi204 ceph-mon[39634]: osdmap e46: 7 total, 7 up, 7 in 2024-01-24T15:37:45.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:44 smithi160 ceph-mon[38982]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:37:45.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:44 smithi160 ceph-mon[38982]: osdmap e46: 7 total, 7 up, 7 in 2024-01-24T15:37:45.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:45 smithi005 ceph-mon[35346]: from='client.? 172.21.15.160:0/4193049169' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cafcc179-ee88-44b5-a3b0-e8d772bf8ac5"}]: dispatch 2024-01-24T15:37:45.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:45 smithi005 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cafcc179-ee88-44b5-a3b0-e8d772bf8ac5"}]: dispatch 2024-01-24T15:37:45.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:45 smithi005 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cafcc179-ee88-44b5-a3b0-e8d772bf8ac5"}]': finished 2024-01-24T15:37:45.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:45 smithi005 ceph-mon[35346]: osdmap e47: 8 total, 7 up, 8 in 2024-01-24T15:37:45.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:45 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-24T15:37:45.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:45 smithi204 ceph-mon[39634]: from='client.? 172.21.15.160:0/4193049169' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cafcc179-ee88-44b5-a3b0-e8d772bf8ac5"}]: dispatch 2024-01-24T15:37:45.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:45 smithi204 ceph-mon[39634]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cafcc179-ee88-44b5-a3b0-e8d772bf8ac5"}]: dispatch 2024-01-24T15:37:45.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:45 smithi204 ceph-mon[39634]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cafcc179-ee88-44b5-a3b0-e8d772bf8ac5"}]': finished 2024-01-24T15:37:45.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:45 smithi204 ceph-mon[39634]: osdmap e47: 8 total, 7 up, 8 in 2024-01-24T15:37:45.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:45 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-24T15:37:46.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:45 smithi160 ceph-mon[38982]: from='client.? 172.21.15.160:0/4193049169' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cafcc179-ee88-44b5-a3b0-e8d772bf8ac5"}]: dispatch 2024-01-24T15:37:46.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:45 smithi160 ceph-mon[38982]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cafcc179-ee88-44b5-a3b0-e8d772bf8ac5"}]: dispatch 2024-01-24T15:37:46.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:45 smithi160 ceph-mon[38982]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cafcc179-ee88-44b5-a3b0-e8d772bf8ac5"}]': finished 2024-01-24T15:37:46.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:45 smithi160 ceph-mon[38982]: osdmap e47: 8 total, 7 up, 8 in 2024-01-24T15:37:46.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:45 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-24T15:37:46.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:46 smithi005 ceph-mon[35346]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:37:46.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:46 smithi005 ceph-mon[35346]: from='client.? 172.21.15.160:0/826594157' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:37:46.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:46 smithi204 ceph-mon[39634]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:37:46.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:46 smithi204 ceph-mon[39634]: from='client.? 172.21.15.160:0/826594157' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:37:47.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:46 smithi160 ceph-mon[38982]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:37:47.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:46 smithi160 ceph-mon[38982]: from='client.? 172.21.15.160:0/826594157' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:37:47.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:47 smithi005 ceph-mon[35346]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:37:47.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:47 smithi204 ceph-mon[39634]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:37:48.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:47 smithi160 ceph-mon[38982]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:37:50.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:50 smithi160 ceph-mon[38982]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:37:50.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:50 smithi005 ceph-mon[35346]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:37:50.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:50 smithi204 ceph-mon[39634]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:37:52.413 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:52 smithi160 ceph-mon[38982]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:37:52.414 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:52 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-01-24T15:37:52.414 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:52 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:52.414 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:52 smithi160 ceph-mon[38982]: Deploying daemon osd.7 on smithi160 2024-01-24T15:37:52.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:52 smithi005 ceph-mon[35346]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:37:52.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:52 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-01-24T15:37:52.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:52 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:52.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:52 smithi005 ceph-mon[35346]: Deploying daemon osd.7 on smithi160 2024-01-24T15:37:52.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:52 smithi204 ceph-mon[39634]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:37:52.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:52 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-01-24T15:37:52.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:52 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:52.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:52 smithi204 ceph-mon[39634]: Deploying daemon osd.7 on smithi160 2024-01-24T15:37:54.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:54 smithi160 ceph-mon[38982]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:37:54.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:54 smithi005 ceph-mon[35346]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:37:54.727 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:54 smithi204 ceph-mon[39634]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:37:56.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:56 smithi160 ceph-mon[38982]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:37:56.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:56 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:56.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:56 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:56.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:56 smithi005 ceph-mon[35346]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:37:56.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:56 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:56.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:56 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:56.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:56 smithi204 ceph-mon[39634]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:37:56.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:56 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:56.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:56 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:57.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:57 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:37:57.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:57 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:37:57.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:57 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:37:58.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:58 smithi005 ceph-mon[35346]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:37:58.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:58 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:58.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:58 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:58.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:58 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:58.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:58 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:37:58.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:37:58 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:58.695 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:58 smithi160 ceph-mon[38982]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:37:58.695 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:58 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:58.695 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:58 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:58.695 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:58 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:58.695 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:58 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:37:58.696 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:37:58 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:58.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:58 smithi204 ceph-mon[39634]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:37:58.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:58 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:58.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:58 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:58.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:58 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:37:58.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:58 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:37:58.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:37:58 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:37:59.107 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:59.105+0000 7fa90ea00700 1 -- 172.21.15.160:0/410787958 <== mgr.14150 v2:172.21.15.5:6800/1971309753 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa918061180 con 0x7fa8f80a05a0 2024-01-24T15:37:59.108 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 7 on host 'smithi160' 2024-01-24T15:37:59.110 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:59.108+0000 7fa91cc00700 1 -- 172.21.15.160:0/410787958 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fa8f80a05a0 msgr2=0x7fa8f80a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:37:59.110 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:59.108+0000 7fa91cc00700 1 --2- 172.21.15.160:0/410787958 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fa8f80a05a0 0x7fa8f80a2a60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa908009990 tx=0x7fa90801a040 comp rx=0 tx=0).stop 2024-01-24T15:37:59.110 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:59.108+0000 7fa91cc00700 1 -- 172.21.15.160:0/410787958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa918101fd0 msgr2=0x7fa918196f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:37:59.110 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:59.108+0000 7fa91cc00700 1 --2- 172.21.15.160:0/410787958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa918101fd0 0x7fa918196f50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa90000d950 tx=0x7fa90000dd10 comp rx=0 tx=0).stop 2024-01-24T15:37:59.110 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:59.108+0000 7fa91cc00700 1 -- 172.21.15.160:0/410787958 shutdown_connections 2024-01-24T15:37:59.110 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:59.108+0000 7fa91cc00700 1 --2- 172.21.15.160:0/410787958 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fa918102970 0x7fa91819dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:37:59.110 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:59.108+0000 7fa91cc00700 1 --2- 172.21.15.160:0/410787958 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fa8f80a05a0 0x7fa8f80a2a60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:37:59.110 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:59.108+0000 7fa91cc00700 1 --2- 172.21.15.160:0/410787958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa918100dd0 0x7fa918196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:37:59.110 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:59.108+0000 7fa91cc00700 1 --2- 172.21.15.160:0/410787958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa918101fd0 0x7fa918196f50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:37:59.110 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:59.108+0000 7fa91cc00700 1 -- 172.21.15.160:0/410787958 >> 172.21.15.160:0/410787958 conn(0x7fa9180fc330 msgr2=0x7fa9180fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:37:59.110 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:59.108+0000 7fa91cc00700 1 -- 172.21.15.160:0/410787958 shutdown_connections 2024-01-24T15:37:59.110 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:37:59.108+0000 7fa91cc00700 1 -- 172.21.15.160:0/410787958 wait complete. 2024-01-24T15:37:59.504 DEBUG:teuthology.orchestra.run.smithi160:osd.7> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.7.service 2024-01-24T15:37:59.508 INFO:tasks.cephadm:Deploying osd.8 on smithi204 with /dev/vg_nvme/lv_2... 2024-01-24T15:37:59.508 DEBUG:teuthology.orchestra.run.smithi204:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-01-24T15:37:59.586 INFO:journalctl@ceph.osd.7.smithi160.stdout:-- Logs begin at Wed 2024-01-24 15:17:12 UTC. -- 2024-01-24T15:37:59.869 INFO:teuthology.orchestra.run.smithi204.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.c/config 2024-01-24T15:38:00.252 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:00 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:00.252 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:00 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:00.252 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:00 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:38:00.252 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:00 smithi160 ceph-mon[38982]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:38:00.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:00 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:00.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:00 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:00.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:00 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:38:00.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:00 smithi005 ceph-mon[35346]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:38:00.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:00 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:00.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:00 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:00.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:00 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:38:00.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:00 smithi204 ceph-mon[39634]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:38:00.507 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:38:00 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:38:00.355+0000 7f115717e640 -1 osd.7 0 log_to_monitors true 2024-01-24T15:38:01.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:01 smithi005 ceph-mon[35346]: from='osd.7 [v2:172.21.15.160:6816/369148145,v1:172.21.15.160:6817/369148145]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-24T15:38:01.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:01 smithi005 ceph-mon[35346]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-24T15:38:01.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:01 smithi204 ceph-mon[39634]: from='osd.7 [v2:172.21.15.160:6816/369148145,v1:172.21.15.160:6817/369148145]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-24T15:38:01.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:01 smithi204 ceph-mon[39634]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-24T15:38:01.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:01 smithi160 ceph-mon[38982]: from='osd.7 [v2:172.21.15.160:6816/369148145,v1:172.21.15.160:6817/369148145]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-24T15:38:01.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:01 smithi160 ceph-mon[38982]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-24T15:38:01.734 INFO:teuthology.orchestra.run.smithi204.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-01-24T15:38:01.735 INFO:teuthology.orchestra.run.smithi204.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-01-24T15:38:01.735 INFO:teuthology.orchestra.run.smithi204.stderr: stderr: 10+0 records in 2024-01-24T15:38:01.735 INFO:teuthology.orchestra.run.smithi204.stderr:10+0 records out 2024-01-24T15:38:01.735 INFO:teuthology.orchestra.run.smithi204.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0303254 s, 346 MB/s 2024-01-24T15:38:01.735 INFO:teuthology.orchestra.run.smithi204.stderr:--> Zapping successful for: 2024-01-24T15:38:02.284 DEBUG:teuthology.orchestra.run.smithi204:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph orch daemon add osd smithi204:vg_nvme/lv_2 2024-01-24T15:38:02.345 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:02 smithi204 ceph-mon[39634]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-01-24T15:38:02.345 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:02 smithi204 ceph-mon[39634]: osdmap e48: 8 total, 7 up, 8 in 2024-01-24T15:38:02.345 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:02 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-24T15:38:02.345 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:02 smithi204 ceph-mon[39634]: from='osd.7 [v2:172.21.15.160:6816/369148145,v1:172.21.15.160:6817/369148145]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-01-24T15:38:02.345 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:02 smithi204 ceph-mon[39634]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-01-24T15:38:02.345 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:02 smithi204 ceph-mon[39634]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:38:02.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:02 smithi005 ceph-mon[35346]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-01-24T15:38:02.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:02 smithi005 ceph-mon[35346]: osdmap e48: 8 total, 7 up, 8 in 2024-01-24T15:38:02.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:02 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-24T15:38:02.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:02 smithi005 ceph-mon[35346]: from='osd.7 [v2:172.21.15.160:6816/369148145,v1:172.21.15.160:6817/369148145]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-01-24T15:38:02.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:02 smithi005 ceph-mon[35346]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-01-24T15:38:02.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:02 smithi005 ceph-mon[35346]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:38:02.507 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:38:02 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:38:02.099+0000 7f114ae00700 -1 osd.7 0 waiting for initial osdmap 2024-01-24T15:38:02.507 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:38:02 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:38:02.112+0000 7f1143e00700 -1 osd.7 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T15:38:02.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:02 smithi160 ceph-mon[38982]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-01-24T15:38:02.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:02 smithi160 ceph-mon[38982]: osdmap e48: 8 total, 7 up, 8 in 2024-01-24T15:38:02.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:02 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-24T15:38:02.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:02 smithi160 ceph-mon[38982]: from='osd.7 [v2:172.21.15.160:6816/369148145,v1:172.21.15.160:6817/369148145]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-01-24T15:38:02.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:02 smithi160 ceph-mon[38982]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-01-24T15:38:02.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:02 smithi160 ceph-mon[38982]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-01-24T15:38:02.643 INFO:teuthology.orchestra.run.smithi204.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.c/config 2024-01-24T15:38:03.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:03 smithi005 ceph-mon[35346]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-01-24T15:38:03.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:03 smithi005 ceph-mon[35346]: osdmap e49: 8 total, 7 up, 8 in 2024-01-24T15:38:03.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:03 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-24T15:38:03.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:03 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-24T15:38:03.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:03 smithi005 ceph-mon[35346]: Detected new or changed devices on smithi160 2024-01-24T15:38:03.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:03 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:03.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:03 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:03.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:03 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:03.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:03 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:03.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:03 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:03.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:03 smithi005 ceph-mon[35346]: Adjusting osd_memory_target on smithi160 to 5757M 2024-01-24T15:38:03.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:03 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:03.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:03 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:03.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:03 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:38:03.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:03 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:03.450 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:03 smithi204 ceph-mon[39634]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-01-24T15:38:03.450 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:03 smithi204 ceph-mon[39634]: osdmap e49: 8 total, 7 up, 8 in 2024-01-24T15:38:03.450 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:03 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-24T15:38:03.450 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:03 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-24T15:38:03.450 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:03 smithi204 ceph-mon[39634]: Detected new or changed devices on smithi160 2024-01-24T15:38:03.450 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:03 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:03.450 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:03 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:03.450 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:03 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:03.450 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:03 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:03.450 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:03 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:03.451 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:03 smithi204 ceph-mon[39634]: Adjusting osd_memory_target on smithi160 to 5757M 2024-01-24T15:38:03.451 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:03 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:03.451 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:03 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:03.451 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:03 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:38:03.451 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:03 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:03.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:03 smithi160 ceph-mon[38982]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-01-24T15:38:03.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:03 smithi160 ceph-mon[38982]: osdmap e49: 8 total, 7 up, 8 in 2024-01-24T15:38:03.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:03 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-24T15:38:03.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:03 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-24T15:38:03.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:03 smithi160 ceph-mon[38982]: Detected new or changed devices on smithi160 2024-01-24T15:38:03.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:03 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:03.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:03 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:03.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:03 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:03.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:03 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:03.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:03 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:03.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:03 smithi160 ceph-mon[38982]: Adjusting osd_memory_target on smithi160 to 5757M 2024-01-24T15:38:03.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:03 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:03.508 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:03 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:03.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:03 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:38:03.509 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:03 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:03.947 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.943+0000 7f0845200700 1 -- 172.21.15.204:0/425402283 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0840101fd0 msgr2=0x7f0840102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:38:03.947 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.943+0000 7f0845200700 1 --2- 172.21.15.204:0/425402283 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0840101fd0 0x7f0840102430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0828009990 tx=0x7f0828009ca0 comp rx=0 tx=0).stop 2024-01-24T15:38:03.947 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.943+0000 7f0845200700 1 -- 172.21.15.204:0/425402283 shutdown_connections 2024-01-24T15:38:03.947 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.944+0000 7f0845200700 1 --2- 172.21.15.204:0/425402283 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0840102970 0x7f0840109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:38:03.947 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.944+0000 7f0845200700 1 --2- 172.21.15.204:0/425402283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0840100dd0 0x7f08401011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:38:03.947 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.944+0000 7f0845200700 1 --2- 172.21.15.204:0/425402283 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0840101fd0 0x7f0840102430 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:38:03.947 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.944+0000 7f0845200700 1 -- 172.21.15.204:0/425402283 >> 172.21.15.204:0/425402283 conn(0x7f08400fc330 msgr2=0x7f08400fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:38:03.947 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.944+0000 7f0845200700 1 -- 172.21.15.204:0/425402283 shutdown_connections 2024-01-24T15:38:03.947 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.944+0000 7f0845200700 1 -- 172.21.15.204:0/425402283 wait complete. 2024-01-24T15:38:03.949 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.945+0000 7f0845200700 1 Processor -- start 2024-01-24T15:38:03.949 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.945+0000 7f0845200700 1 -- start start 2024-01-24T15:38:03.949 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.945+0000 7f0845200700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0840100dd0 0x7f0840198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:38:03.949 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.945+0000 7f0845200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0840101fd0 0x7f08401990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:38:03.949 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.945+0000 7f0845200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0840102970 0x7f08401a0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:38:03.949 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.945+0000 7f0845200700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08401a0710 con 0x7f0840101fd0 2024-01-24T15:38:03.950 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.945+0000 7f0845200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08401a0850 con 0x7f0840102970 2024-01-24T15:38:03.950 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.945+0000 7f0845200700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08401a09e0 con 0x7f0840100dd0 2024-01-24T15:38:03.950 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.945+0000 7f083de00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0840100dd0 0x7f0840198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:38:03.950 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.945+0000 7f083de00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0840100dd0 0x7f0840198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:60488/0 (socket says 172.21.15.204:60488) 2024-01-24T15:38:03.950 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.945+0000 7f083de00700 1 -- 172.21.15.204:0/758303084 learned_addr learned my addr 172.21.15.204:0/758303084 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-01-24T15:38:03.950 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.946+0000 7f083d400700 1 --2- 172.21.15.204:0/758303084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0840101fd0 0x7f08401990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:38:03.950 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.946+0000 7f083e800700 1 --2- 172.21.15.204:0/758303084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0840102970 0x7f08401a0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:38:03.950 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.946+0000 7f083de00700 1 -- 172.21.15.204:0/758303084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0840102970 msgr2=0x7f08401a0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:38:03.950 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.946+0000 7f083de00700 1 --2- 172.21.15.204:0/758303084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0840102970 0x7f08401a0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:38:03.950 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.946+0000 7f083de00700 1 -- 172.21.15.204:0/758303084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0840101fd0 msgr2=0x7f08401990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:38:03.950 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.946+0000 7f083de00700 1 --2- 172.21.15.204:0/758303084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0840101fd0 0x7f08401990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:38:03.950 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.946+0000 7f083de00700 1 -- 172.21.15.204:0/758303084 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08280095f0 con 0x7f0840100dd0 2024-01-24T15:38:03.950 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.946+0000 7f083d400700 1 --2- 172.21.15.204:0/758303084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0840101fd0 0x7f08401990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T15:38:03.951 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.946+0000 7f083de00700 1 --2- 172.21.15.204:0/758303084 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0840100dd0 0x7f0840198b80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f083000d9b0 tx=0x7f083000dd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:38:03.951 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.946+0000 7f0836a00700 1 -- 172.21.15.204:0/758303084 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083000be80 con 0x7f0840100dd0 2024-01-24T15:38:03.951 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.946+0000 7f0836a00700 1 -- 172.21.15.204:0/758303084 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08300044b0 con 0x7f0840100dd0 2024-01-24T15:38:03.951 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.946+0000 7f0836a00700 1 -- 172.21.15.204:0/758303084 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0830003aa0 con 0x7f0840100dd0 2024-01-24T15:38:03.951 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.946+0000 7f0845200700 1 -- 172.21.15.204:0/758303084 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08401a0cc0 con 0x7f0840100dd0 2024-01-24T15:38:03.951 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.947+0000 7f0845200700 1 -- 172.21.15.204:0/758303084 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08401a1170 con 0x7f0840100dd0 2024-01-24T15:38:03.951 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.948+0000 7f0845200700 1 -- 172.21.15.204:0/758303084 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08401932c0 con 0x7f0840100dd0 2024-01-24T15:38:03.952 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.949+0000 7f0836a00700 1 -- 172.21.15.204:0/758303084 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f0830009940 con 0x7f0840100dd0 2024-01-24T15:38:03.953 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.951+0000 7f0836a00700 1 --2- 172.21.15.204:0/758303084 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f08200a0620 0x7f08200a2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:38:03.953 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.951+0000 7f0836a00700 1 -- 172.21.15.204:0/758303084 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5426+0+0 (secure 0 0 0) 0x7f08300cab70 con 0x7f0840100dd0 2024-01-24T15:38:03.953 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.951+0000 7f083d400700 1 --2- 172.21.15.204:0/758303084 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f08200a0620 0x7f08200a2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:38:03.954 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.952+0000 7f083d400700 1 --2- 172.21.15.204:0/758303084 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f08200a0620 0x7f08200a2ae0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f082800b5c0 tx=0x7f0828005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:38:03.957 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:03.955+0000 7f0836a00700 1 -- 172.21.15.204:0/758303084 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f08300951b0 con 0x7f0840100dd0 2024-01-24T15:38:04.165 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:04.163+0000 7f0845200700 1 -- 172.21.15.204:0/758303084 --> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi204:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f0840061b40 con 0x7f08200a0620 2024-01-24T15:38:04.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:04 smithi005 ceph-mon[35346]: purged_snaps scrub starts 2024-01-24T15:38:04.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:04 smithi005 ceph-mon[35346]: purged_snaps scrub ok 2024-01-24T15:38:04.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:04 smithi005 ceph-mon[35346]: osd.7 [v2:172.21.15.160:6816/369148145,v1:172.21.15.160:6817/369148145] boot 2024-01-24T15:38:04.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:04 smithi005 ceph-mon[35346]: osdmap e50: 8 total, 8 up, 8 in 2024-01-24T15:38:04.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:04 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-24T15:38:04.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:04 smithi005 ceph-mon[35346]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:04.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:04 smithi005 ceph-mon[35346]: osdmap e51: 8 total, 8 up, 8 in 2024-01-24T15:38:04.474 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:04 smithi204 ceph-mon[39634]: purged_snaps scrub starts 2024-01-24T15:38:04.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:04 smithi204 ceph-mon[39634]: purged_snaps scrub ok 2024-01-24T15:38:04.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:04 smithi204 ceph-mon[39634]: osd.7 [v2:172.21.15.160:6816/369148145,v1:172.21.15.160:6817/369148145] boot 2024-01-24T15:38:04.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:04 smithi204 ceph-mon[39634]: osdmap e50: 8 total, 8 up, 8 in 2024-01-24T15:38:04.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:04 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-24T15:38:04.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:04 smithi204 ceph-mon[39634]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:04.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:04 smithi204 ceph-mon[39634]: osdmap e51: 8 total, 8 up, 8 in 2024-01-24T15:38:04.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:04 smithi160 ceph-mon[38982]: purged_snaps scrub starts 2024-01-24T15:38:04.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:04 smithi160 ceph-mon[38982]: purged_snaps scrub ok 2024-01-24T15:38:04.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:04 smithi160 ceph-mon[38982]: osd.7 [v2:172.21.15.160:6816/369148145,v1:172.21.15.160:6817/369148145] boot 2024-01-24T15:38:04.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:04 smithi160 ceph-mon[38982]: osdmap e50: 8 total, 8 up, 8 in 2024-01-24T15:38:04.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:04 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-24T15:38:04.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:04 smithi160 ceph-mon[38982]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:04.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:04 smithi160 ceph-mon[38982]: osdmap e51: 8 total, 8 up, 8 in 2024-01-24T15:38:05.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:05 smithi005 ceph-mon[35346]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi204:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:38:05.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:05 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:38:05.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:05 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:38:05.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:05 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:05.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:05 smithi005 ceph-mon[35346]: osdmap e52: 8 total, 8 up, 8 in 2024-01-24T15:38:05.474 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:05 smithi204 ceph-mon[39634]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi204:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:38:05.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:05 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:38:05.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:05 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:38:05.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:05 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:05.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:05 smithi204 ceph-mon[39634]: osdmap e52: 8 total, 8 up, 8 in 2024-01-24T15:38:05.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:05 smithi160 ceph-mon[38982]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi204:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:38:05.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:05 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:38:05.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:05 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:38:05.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:05 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:05.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:05 smithi160 ceph-mon[38982]: osdmap e52: 8 total, 8 up, 8 in 2024-01-24T15:38:06.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:06 smithi005 ceph-mon[35346]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:06.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:06 smithi005 ceph-mon[35346]: osdmap e53: 8 total, 8 up, 8 in 2024-01-24T15:38:06.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:06 smithi204 ceph-mon[39634]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:06.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:06 smithi204 ceph-mon[39634]: osdmap e53: 8 total, 8 up, 8 in 2024-01-24T15:38:06.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:06 smithi160 ceph-mon[38982]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:06.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:06 smithi160 ceph-mon[38982]: osdmap e53: 8 total, 8 up, 8 in 2024-01-24T15:38:07.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:07 smithi005 ceph-mon[35346]: osdmap e54: 8 total, 8 up, 8 in 2024-01-24T15:38:07.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:07 smithi005 ceph-mon[35346]: from='client.? 172.21.15.204:0/836942480' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "02951778-7bd2-4628-a9e2-4029d1d94fea"}]: dispatch 2024-01-24T15:38:07.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:07 smithi005 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "02951778-7bd2-4628-a9e2-4029d1d94fea"}]: dispatch 2024-01-24T15:38:07.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:07 smithi005 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "02951778-7bd2-4628-a9e2-4029d1d94fea"}]': finished 2024-01-24T15:38:07.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:07 smithi005 ceph-mon[35346]: osdmap e55: 9 total, 8 up, 9 in 2024-01-24T15:38:07.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:07 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-24T15:38:07.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:07 smithi204 ceph-mon[39634]: osdmap e54: 8 total, 8 up, 8 in 2024-01-24T15:38:07.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:07 smithi204 ceph-mon[39634]: from='client.? 172.21.15.204:0/836942480' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "02951778-7bd2-4628-a9e2-4029d1d94fea"}]: dispatch 2024-01-24T15:38:07.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:07 smithi204 ceph-mon[39634]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "02951778-7bd2-4628-a9e2-4029d1d94fea"}]: dispatch 2024-01-24T15:38:07.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:07 smithi204 ceph-mon[39634]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "02951778-7bd2-4628-a9e2-4029d1d94fea"}]': finished 2024-01-24T15:38:07.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:07 smithi204 ceph-mon[39634]: osdmap e55: 9 total, 8 up, 9 in 2024-01-24T15:38:07.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:07 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-24T15:38:07.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:07 smithi160 ceph-mon[38982]: osdmap e54: 8 total, 8 up, 8 in 2024-01-24T15:38:07.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:07 smithi160 ceph-mon[38982]: from='client.? 172.21.15.204:0/836942480' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "02951778-7bd2-4628-a9e2-4029d1d94fea"}]: dispatch 2024-01-24T15:38:07.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:07 smithi160 ceph-mon[38982]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "02951778-7bd2-4628-a9e2-4029d1d94fea"}]: dispatch 2024-01-24T15:38:07.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:07 smithi160 ceph-mon[38982]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "02951778-7bd2-4628-a9e2-4029d1d94fea"}]': finished 2024-01-24T15:38:07.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:07 smithi160 ceph-mon[38982]: osdmap e55: 9 total, 8 up, 9 in 2024-01-24T15:38:07.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:07 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-24T15:38:08.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:08 smithi005 ceph-mon[35346]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:08.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:08 smithi005 ceph-mon[35346]: from='client.? 172.21.15.204:0/2320607423' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:38:08.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:08 smithi204 ceph-mon[39634]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:08.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:08 smithi204 ceph-mon[39634]: from='client.? 172.21.15.204:0/2320607423' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:38:08.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:08 smithi160 ceph-mon[38982]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:08.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:08 smithi160 ceph-mon[38982]: from='client.? 172.21.15.204:0/2320607423' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:38:10.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:10 smithi005 ceph-mon[35346]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:10.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:10 smithi204 ceph-mon[39634]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:10.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:10 smithi160 ceph-mon[38982]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:12.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:12 smithi204 ceph-mon[39634]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:12.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:12 smithi005 ceph-mon[35346]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:12.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:12 smithi160 ceph-mon[38982]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:14.626 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:14 smithi204 ceph-mon[39634]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:14.626 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:14 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-01-24T15:38:14.627 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:14 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:14.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:14 smithi005 ceph-mon[35346]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:14.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:14 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-01-24T15:38:14.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:14 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:14.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:14 smithi160 ceph-mon[38982]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:14.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:14 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-01-24T15:38:14.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:14 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:15.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:15 smithi204 ceph-mon[39634]: Deploying daemon osd.8 on smithi204 2024-01-24T15:38:15.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:15 smithi005 ceph-mon[35346]: Deploying daemon osd.8 on smithi204 2024-01-24T15:38:15.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:15 smithi160 ceph-mon[38982]: Deploying daemon osd.8 on smithi204 2024-01-24T15:38:16.364 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:16 smithi204 ceph-mon[39634]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:16.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:16 smithi005 ceph-mon[35346]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:16.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:16 smithi160 ceph-mon[38982]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:18.562 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:18 smithi204 ceph-mon[39634]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:18.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:18 smithi005 ceph-mon[35346]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:18.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:18 smithi160 ceph-mon[38982]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:20.346 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:20 smithi204 ceph-mon[39634]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:20.346 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:20 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:20.346 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:20 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:20.346 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:20 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:38:20.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:20 smithi005 ceph-mon[35346]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:20.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:20 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:20.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:20 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:20.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:20 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:38:20.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:20 smithi160 ceph-mon[38982]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:20.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:20 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:20.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:20 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:20.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:20 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:38:22.570 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:22 smithi204 ceph-mon[39634]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:22.571 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:22 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:22.571 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:22 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:22.571 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:22 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:22.571 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:22 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:38:22.571 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:22 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:22.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:22 smithi005 ceph-mon[35346]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:22.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:22 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:22.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:22 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:22.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:22 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:22.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:22 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:38:22.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:22 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:22.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:22 smithi160 ceph-mon[38982]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:22.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:22 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:22.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:22 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:22.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:22 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:22.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:22 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:38:22.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:22 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:22.843 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:22.841+0000 7f0836a00700 1 -- 172.21.15.204:0/758303084 <== mgr.14150 v2:172.21.15.5:6800/1971309753 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0840061b40 con 0x7f08200a0620 2024-01-24T15:38:22.843 INFO:teuthology.orchestra.run.smithi204.stdout:Created osd(s) 8 on host 'smithi204' 2024-01-24T15:38:22.846 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:22.844+0000 7f0845200700 1 -- 172.21.15.204:0/758303084 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f08200a0620 msgr2=0x7f08200a2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:38:22.846 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:22.844+0000 7f0845200700 1 --2- 172.21.15.204:0/758303084 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f08200a0620 0x7f08200a2ae0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f082800b5c0 tx=0x7f0828005fd0 comp rx=0 tx=0).stop 2024-01-24T15:38:22.846 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:22.844+0000 7f0845200700 1 -- 172.21.15.204:0/758303084 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0840100dd0 msgr2=0x7f0840198b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:38:22.846 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:22.844+0000 7f0845200700 1 --2- 172.21.15.204:0/758303084 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0840100dd0 0x7f0840198b80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f083000d9b0 tx=0x7f083000dd70 comp rx=0 tx=0).stop 2024-01-24T15:38:22.846 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:22.844+0000 7f0845200700 1 -- 172.21.15.204:0/758303084 shutdown_connections 2024-01-24T15:38:22.846 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:22.844+0000 7f0845200700 1 --2- 172.21.15.204:0/758303084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0840102970 0x7f08401a0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:38:22.846 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:22.844+0000 7f0845200700 1 --2- 172.21.15.204:0/758303084 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0840100dd0 0x7f0840198b80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:38:22.846 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:22.844+0000 7f0845200700 1 --2- 172.21.15.204:0/758303084 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f08200a0620 0x7f08200a2ae0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:38:22.846 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:22.844+0000 7f0845200700 1 --2- 172.21.15.204:0/758303084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0840101fd0 0x7f08401990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:38:22.846 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:22.844+0000 7f0845200700 1 -- 172.21.15.204:0/758303084 >> 172.21.15.204:0/758303084 conn(0x7f08400fc330 msgr2=0x7f08401078f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:38:22.846 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:22.844+0000 7f0845200700 1 -- 172.21.15.204:0/758303084 shutdown_connections 2024-01-24T15:38:22.846 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:38:22.844+0000 7f0845200700 1 -- 172.21.15.204:0/758303084 wait complete. 2024-01-24T15:38:23.329 DEBUG:teuthology.orchestra.run.smithi204:osd.8> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.8.service 2024-01-24T15:38:23.333 INFO:tasks.cephadm:Deploying osd.9 on smithi005 with /dev/vg_nvme/lv_1... 2024-01-24T15:38:23.333 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-01-24T15:38:23.403 INFO:journalctl@ceph.osd.8.smithi204.stdout:-- Logs begin at Wed 2024-01-24 15:17:05 UTC. -- 2024-01-24T15:38:23.708 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.a/config 2024-01-24T15:38:23.975 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:38:23 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:38:23.610+0000 7f4130bde640 -1 osd.8 0 log_to_monitors true 2024-01-24T15:38:23.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:23 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:23.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:23 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:23.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:23 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:38:23.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:23 smithi204 ceph-mon[39634]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:23.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:23 smithi204 ceph-mon[39634]: from='osd.8 [v2:172.21.15.204:6816/1351316997,v1:172.21.15.204:6817/1351316997]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-01-24T15:38:24.179 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:23 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:24.180 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:23 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:24.180 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:23 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:38:24.180 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:23 smithi005 ceph-mon[35346]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:24.180 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:23 smithi005 ceph-mon[35346]: from='osd.8 [v2:172.21.15.204:6816/1351316997,v1:172.21.15.204:6817/1351316997]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-01-24T15:38:24.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:23 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:24.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:23 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:24.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:23 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:38:24.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:23 smithi160 ceph-mon[38982]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:24.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:23 smithi160 ceph-mon[38982]: from='osd.8 [v2:172.21.15.204:6816/1351316997,v1:172.21.15.204:6817/1351316997]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-01-24T15:38:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-01-24T15:38:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-01-24T15:38:25.297 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10+0 records in 2024-01-24T15:38:25.297 INFO:teuthology.orchestra.run.smithi005.stderr:10+0 records out 2024-01-24T15:38:25.298 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0510104 s, 206 MB/s 2024-01-24T15:38:25.298 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping successful for: 2024-01-24T15:38:25.655 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:25 smithi005 ceph-mon[35346]: from='osd.8 [v2:172.21.15.204:6816/1351316997,v1:172.21.15.204:6817/1351316997]' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-01-24T15:38:25.655 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:25 smithi005 ceph-mon[35346]: osdmap e56: 9 total, 8 up, 9 in 2024-01-24T15:38:25.655 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:25 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-24T15:38:25.655 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:25 smithi005 ceph-mon[35346]: from='osd.8 [v2:172.21.15.204:6816/1351316997,v1:172.21.15.204:6817/1351316997]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]: dispatch 2024-01-24T15:38:25.682 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph orch daemon add osd smithi005:vg_nvme/lv_1 2024-01-24T15:38:25.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:25 smithi204 ceph-mon[39634]: from='osd.8 [v2:172.21.15.204:6816/1351316997,v1:172.21.15.204:6817/1351316997]' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-01-24T15:38:25.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:25 smithi204 ceph-mon[39634]: osdmap e56: 9 total, 8 up, 9 in 2024-01-24T15:38:25.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:25 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-24T15:38:25.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:25 smithi204 ceph-mon[39634]: from='osd.8 [v2:172.21.15.204:6816/1351316997,v1:172.21.15.204:6817/1351316997]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]: dispatch 2024-01-24T15:38:25.726 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:38:25 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:38:25.286+0000 7f4126600700 -1 osd.8 0 waiting for initial osdmap 2024-01-24T15:38:25.726 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:38:25 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:38:25.303+0000 7f411ec00700 -1 osd.8 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T15:38:25.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:25 smithi160 ceph-mon[38982]: from='osd.8 [v2:172.21.15.204:6816/1351316997,v1:172.21.15.204:6817/1351316997]' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-01-24T15:38:25.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:25 smithi160 ceph-mon[38982]: osdmap e56: 9 total, 8 up, 9 in 2024-01-24T15:38:25.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:25 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-24T15:38:25.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:25 smithi160 ceph-mon[38982]: from='osd.8 [v2:172.21.15.204:6816/1351316997,v1:172.21.15.204:6817/1351316997]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]: dispatch 2024-01-24T15:38:26.043 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.a/config 2024-01-24T15:38:26.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:26 smithi005 ceph-mon[35346]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:26.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:26 smithi005 ceph-mon[35346]: from='osd.8 [v2:172.21.15.204:6816/1351316997,v1:172.21.15.204:6817/1351316997]' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]': finished 2024-01-24T15:38:26.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:26 smithi005 ceph-mon[35346]: osdmap e57: 9 total, 8 up, 9 in 2024-01-24T15:38:26.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:26 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-24T15:38:26.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:26 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-24T15:38:26.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:26 smithi204 ceph-mon[39634]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:26.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:26 smithi204 ceph-mon[39634]: from='osd.8 [v2:172.21.15.204:6816/1351316997,v1:172.21.15.204:6817/1351316997]' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]': finished 2024-01-24T15:38:26.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:26 smithi204 ceph-mon[39634]: osdmap e57: 9 total, 8 up, 9 in 2024-01-24T15:38:26.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:26 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-24T15:38:26.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:26 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-24T15:38:26.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:26 smithi160 ceph-mon[38982]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:26.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:26 smithi160 ceph-mon[38982]: from='osd.8 [v2:172.21.15.204:6816/1351316997,v1:172.21.15.204:6817/1351316997]' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]': finished 2024-01-24T15:38:26.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:26 smithi160 ceph-mon[38982]: osdmap e57: 9 total, 8 up, 9 in 2024-01-24T15:38:26.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:26 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-24T15:38:26.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:26 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-24T15:38:27.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.122+0000 7f1855200700 1 -- 172.21.15.5:0/2709634114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1850104190 msgr2=0x7f1850106580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:38:27.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.122+0000 7f1855200700 1 --2- 172.21.15.5:0/2709634114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1850104190 0x7f1850106580 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1838009990 tx=0x7f1838009ca0 comp rx=0 tx=0).stop 2024-01-24T15:38:27.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.123+0000 7f1855200700 1 -- 172.21.15.5:0/2709634114 shutdown_connections 2024-01-24T15:38:27.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.123+0000 7f1855200700 1 --2- 172.21.15.5:0/2709634114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1850106ac0 0x7f1850108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:38:27.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.123+0000 7f1855200700 1 --2- 172.21.15.5:0/2709634114 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1850101860 0x7f1850103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:38:27.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.123+0000 7f1855200700 1 --2- 172.21.15.5:0/2709634114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1850104190 0x7f1850106580 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:38:27.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.123+0000 7f1855200700 1 -- 172.21.15.5:0/2709634114 >> 172.21.15.5:0/2709634114 conn(0x7f18500fb250 msgr2=0x7f18500fd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:38:27.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.123+0000 7f1855200700 1 -- 172.21.15.5:0/2709634114 shutdown_connections 2024-01-24T15:38:27.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.123+0000 7f1855200700 1 -- 172.21.15.5:0/2709634114 wait complete. 2024-01-24T15:38:27.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.124+0000 7f1855200700 1 Processor -- start 2024-01-24T15:38:27.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.124+0000 7f1855200700 1 -- start start 2024-01-24T15:38:27.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.124+0000 7f1855200700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1850101860 0x7f1850198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:38:27.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.124+0000 7f1855200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1850104190 0x7f18501991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:38:27.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.124+0000 7f1855200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1850106ac0 0x7f18501a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:38:27.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.124+0000 7f1855200700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18501a07b0 con 0x7f1850104190 2024-01-24T15:38:27.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.124+0000 7f1855200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18501a08f0 con 0x7f1850106ac0 2024-01-24T15:38:27.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.124+0000 7f1855200700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18501a0ab0 con 0x7f1850101860 2024-01-24T15:38:27.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.125+0000 7f184d400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1850104190 0x7f18501991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:38:27.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.125+0000 7f184d400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1850104190 0x7f18501991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35550/0 (socket says 172.21.15.5:35550) 2024-01-24T15:38:27.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.125+0000 7f184d400700 1 -- 172.21.15.5:0/3066531166 learned_addr learned my addr 172.21.15.5:0/3066531166 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:38:27.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.125+0000 7f184e800700 1 --2- 172.21.15.5:0/3066531166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1850106ac0 0x7f18501a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:38:27.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.125+0000 7f184de00700 1 --2- 172.21.15.5:0/3066531166 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1850101860 0x7f1850198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:38:27.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.125+0000 7f184d400700 1 -- 172.21.15.5:0/3066531166 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1850101860 msgr2=0x7f1850198c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:38:27.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.125+0000 7f184d400700 1 --2- 172.21.15.5:0/3066531166 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1850101860 0x7f1850198c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:38:27.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.125+0000 7f184d400700 1 -- 172.21.15.5:0/3066531166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1850106ac0 msgr2=0x7f18501a01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:38:27.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.125+0000 7f184d400700 1 --2- 172.21.15.5:0/3066531166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1850106ac0 0x7f18501a01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:38:27.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.125+0000 7f184d400700 1 -- 172.21.15.5:0/3066531166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18380095f0 con 0x7f1850104190 2024-01-24T15:38:27.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.125+0000 7f184d400700 1 --2- 172.21.15.5:0/3066531166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1850104190 0x7f18501991a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1838005910 tx=0x7f18380057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:38:27.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.126+0000 7f1846a00700 1 -- 172.21.15.5:0/3066531166 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183801d070 con 0x7f1850104190 2024-01-24T15:38:27.129 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.126+0000 7f1846a00700 1 -- 172.21.15.5:0/3066531166 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1838022470 con 0x7f1850104190 2024-01-24T15:38:27.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.126+0000 7f1846a00700 1 -- 172.21.15.5:0/3066531166 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183800f6c0 con 0x7f1850104190 2024-01-24T15:38:27.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.126+0000 7f1855200700 1 -- 172.21.15.5:0/3066531166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18501a0d30 con 0x7f1850104190 2024-01-24T15:38:27.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.126+0000 7f1855200700 1 -- 172.21.15.5:0/3066531166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18501a1140 con 0x7f1850104190 2024-01-24T15:38:27.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.127+0000 7f1855200700 1 -- 172.21.15.5:0/3066531166 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1850108690 con 0x7f1850104190 2024-01-24T15:38:27.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.129+0000 7f1846a00700 1 -- 172.21.15.5:0/3066531166 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f18380225e0 con 0x7f1850104190 2024-01-24T15:38:27.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.130+0000 7f1846a00700 1 --2- 172.21.15.5:0/3066531166 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f18300a05a0 0x7f18300a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:38:27.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.130+0000 7f1846a00700 1 -- 172.21.15.5:0/3066531166 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5862+0+0 (secure 0 0 0) 0x7f18380cccc0 con 0x7f1850104190 2024-01-24T15:38:27.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.130+0000 7f184de00700 1 --2- 172.21.15.5:0/3066531166 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f18300a05a0 0x7f18300a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:38:27.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.131+0000 7f184de00700 1 --2- 172.21.15.5:0/3066531166 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f18300a05a0 0x7f18300a2a60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f185019a140 tx=0x7f1840009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:38:27.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.133+0000 7f1846a00700 1 -- 172.21.15.5:0/3066531166 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f18380971e0 con 0x7f1850104190 2024-01-24T15:38:27.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:27.353+0000 7f1855200700 1 -- 172.21.15.5:0/3066531166 --> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f1850061180 con 0x7f18300a05a0 2024-01-24T15:38:27.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:27 smithi005 ceph-mon[35346]: purged_snaps scrub starts 2024-01-24T15:38:27.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:27 smithi005 ceph-mon[35346]: purged_snaps scrub ok 2024-01-24T15:38:27.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:27 smithi005 ceph-mon[35346]: osd.8 [v2:172.21.15.204:6816/1351316997,v1:172.21.15.204:6817/1351316997] boot 2024-01-24T15:38:27.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:27 smithi005 ceph-mon[35346]: osdmap e58: 9 total, 9 up, 9 in 2024-01-24T15:38:27.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:27 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-24T15:38:27.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:27 smithi005 ceph-mon[35346]: Detected new or changed devices on smithi204 2024-01-24T15:38:27.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:27 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:27.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:27 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:27.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:27 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:27.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:27 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:27.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:27 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:27.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:27 smithi005 ceph-mon[35346]: Adjusting osd_memory_target on smithi204 to 5757M 2024-01-24T15:38:27.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:27 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:27.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:27 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:27.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:27 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:38:27.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:27 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:27.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:27 smithi204 ceph-mon[39634]: purged_snaps scrub starts 2024-01-24T15:38:27.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:27 smithi204 ceph-mon[39634]: purged_snaps scrub ok 2024-01-24T15:38:27.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:27 smithi204 ceph-mon[39634]: osd.8 [v2:172.21.15.204:6816/1351316997,v1:172.21.15.204:6817/1351316997] boot 2024-01-24T15:38:27.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:27 smithi204 ceph-mon[39634]: osdmap e58: 9 total, 9 up, 9 in 2024-01-24T15:38:27.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:27 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-24T15:38:27.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:27 smithi204 ceph-mon[39634]: Detected new or changed devices on smithi204 2024-01-24T15:38:27.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:27 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:27.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:27 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:27.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:27 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:27.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:27 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:27.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:27 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:27.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:27 smithi204 ceph-mon[39634]: Adjusting osd_memory_target on smithi204 to 5757M 2024-01-24T15:38:27.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:27 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:27.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:27 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:27.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:27 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:38:27.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:27 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:27.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:27 smithi160 ceph-mon[38982]: purged_snaps scrub starts 2024-01-24T15:38:27.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:27 smithi160 ceph-mon[38982]: purged_snaps scrub ok 2024-01-24T15:38:27.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:27 smithi160 ceph-mon[38982]: osd.8 [v2:172.21.15.204:6816/1351316997,v1:172.21.15.204:6817/1351316997] boot 2024-01-24T15:38:27.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:27 smithi160 ceph-mon[38982]: osdmap e58: 9 total, 9 up, 9 in 2024-01-24T15:38:27.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:27 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-24T15:38:27.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:27 smithi160 ceph-mon[38982]: Detected new or changed devices on smithi204 2024-01-24T15:38:27.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:27 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:27.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:27 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:27.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:27 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:27.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:27 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:27.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:27 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:27.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:27 smithi160 ceph-mon[38982]: Adjusting osd_memory_target on smithi204 to 5757M 2024-01-24T15:38:27.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:27 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:27.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:27 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:27.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:27 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:38:27.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:27 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:28.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:28 smithi005 ceph-mon[35346]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:28.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:28 smithi005 ceph-mon[35346]: osdmap e59: 9 total, 9 up, 9 in 2024-01-24T15:38:28.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:28 smithi005 ceph-mon[35346]: from='client.14457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:38:28.628 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:28 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:38:28.628 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:28 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:38:28.628 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:28 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:28.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:28 smithi204 ceph-mon[39634]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:28.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:28 smithi204 ceph-mon[39634]: osdmap e59: 9 total, 9 up, 9 in 2024-01-24T15:38:28.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:28 smithi204 ceph-mon[39634]: from='client.14457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:38:28.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:28 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:38:28.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:28 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:38:28.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:28 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:28.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:28 smithi160 ceph-mon[38982]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-01-24T15:38:28.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:28 smithi160 ceph-mon[38982]: osdmap e59: 9 total, 9 up, 9 in 2024-01-24T15:38:28.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:28 smithi160 ceph-mon[38982]: from='client.14457 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:38:28.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:28 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:38:28.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:28 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:38:28.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:28 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:29.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:29 smithi005 ceph-mon[35346]: osdmap e60: 9 total, 9 up, 9 in 2024-01-24T15:38:29.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:29 smithi204 ceph-mon[39634]: osdmap e60: 9 total, 9 up, 9 in 2024-01-24T15:38:29.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:29 smithi160 ceph-mon[38982]: osdmap e60: 9 total, 9 up, 9 in 2024-01-24T15:38:30.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:30 smithi005 ceph-mon[35346]: pgmap v181: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2024-01-24T15:38:30.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:30 smithi005 ceph-mon[35346]: osdmap e61: 9 total, 9 up, 9 in 2024-01-24T15:38:30.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:30 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/1531362172' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae93d215-dc45-4916-a42d-72d7da51260c"}]: dispatch 2024-01-24T15:38:30.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:30 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/1531362172' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ae93d215-dc45-4916-a42d-72d7da51260c"}]': finished 2024-01-24T15:38:30.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:30 smithi005 ceph-mon[35346]: osdmap e62: 10 total, 9 up, 10 in 2024-01-24T15:38:30.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:30 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-24T15:38:30.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:30 smithi204 ceph-mon[39634]: pgmap v181: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2024-01-24T15:38:30.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:30 smithi204 ceph-mon[39634]: osdmap e61: 9 total, 9 up, 9 in 2024-01-24T15:38:30.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:30 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/1531362172' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae93d215-dc45-4916-a42d-72d7da51260c"}]: dispatch 2024-01-24T15:38:30.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:30 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/1531362172' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ae93d215-dc45-4916-a42d-72d7da51260c"}]': finished 2024-01-24T15:38:30.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:30 smithi204 ceph-mon[39634]: osdmap e62: 10 total, 9 up, 10 in 2024-01-24T15:38:30.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:30 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-24T15:38:30.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:30 smithi160 ceph-mon[38982]: pgmap v181: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2024-01-24T15:38:30.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:30 smithi160 ceph-mon[38982]: osdmap e61: 9 total, 9 up, 9 in 2024-01-24T15:38:30.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:30 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/1531362172' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae93d215-dc45-4916-a42d-72d7da51260c"}]: dispatch 2024-01-24T15:38:30.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:30 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/1531362172' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ae93d215-dc45-4916-a42d-72d7da51260c"}]': finished 2024-01-24T15:38:30.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:30 smithi160 ceph-mon[38982]: osdmap e62: 10 total, 9 up, 10 in 2024-01-24T15:38:30.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:30 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-24T15:38:31.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:31 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/1831069652' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:38:31.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:31 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/1831069652' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:38:31.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:31 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/1831069652' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:38:32.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:32 smithi005 ceph-mon[35346]: pgmap v184: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2024-01-24T15:38:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:32 smithi204 ceph-mon[39634]: pgmap v184: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2024-01-24T15:38:32.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:32 smithi160 ceph-mon[38982]: pgmap v184: 1 pgs: 1 remapped+peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2024-01-24T15:38:34.649 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:34 smithi005 ceph-mon[35346]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-01-24T15:38:34.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:34 smithi204 ceph-mon[39634]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-01-24T15:38:34.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:34 smithi160 ceph-mon[38982]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-01-24T15:38:36.432 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:36 smithi005 ceph-mon[35346]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-01-24T15:38:36.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:36 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-01-24T15:38:36.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:36 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:36.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:36 smithi204 ceph-mon[39634]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-01-24T15:38:36.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:36 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-01-24T15:38:36.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:36 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:36.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:36 smithi160 ceph-mon[38982]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-01-24T15:38:36.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:36 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-01-24T15:38:36.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:36 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:37.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:37 smithi005 ceph-mon[35346]: Deploying daemon osd.9 on smithi005 2024-01-24T15:38:37.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:37 smithi204 ceph-mon[39634]: Deploying daemon osd.9 on smithi005 2024-01-24T15:38:37.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:37 smithi160 ceph-mon[38982]: Deploying daemon osd.9 on smithi005 2024-01-24T15:38:38.530 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:38 smithi005 ceph-mon[35346]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-01-24T15:38:38.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:38 smithi204 ceph-mon[39634]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-01-24T15:38:38.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:38 smithi160 ceph-mon[38982]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-01-24T15:38:40.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:40 smithi005 ceph-mon[35346]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-01-24T15:38:40.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:40 smithi204 ceph-mon[39634]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-01-24T15:38:40.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:40 smithi160 ceph-mon[38982]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-01-24T15:38:42.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:41 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:42.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:41 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:42.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:41 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:38:42.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:41 smithi005 ceph-mon[35346]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-01-24T15:38:42.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:41 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:42.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:41 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:42.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:41 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:38:42.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:41 smithi160 ceph-mon[38982]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-01-24T15:38:42.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:41 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:42.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:41 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:42.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:41 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:38:42.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:41 smithi204 ceph-mon[39634]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-01-24T15:38:43.608 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:43.606+0000 7f1846a00700 1 -- 172.21.15.5:0/3066531166 <== mgr.14150 v2:172.21.15.5:6800/1971309753 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1850061180 con 0x7f18300a05a0 2024-01-24T15:38:43.608 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 9 on host 'smithi005' 2024-01-24T15:38:43.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:43.608+0000 7f1855200700 1 -- 172.21.15.5:0/3066531166 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f18300a05a0 msgr2=0x7f18300a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:38:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:43.608+0000 7f1855200700 1 --2- 172.21.15.5:0/3066531166 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f18300a05a0 0x7f18300a2a60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f185019a140 tx=0x7f1840009260 comp rx=0 tx=0).stop 2024-01-24T15:38:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:43.608+0000 7f1855200700 1 -- 172.21.15.5:0/3066531166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1850104190 msgr2=0x7f18501991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:38:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:43.608+0000 7f1855200700 1 --2- 172.21.15.5:0/3066531166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1850104190 0x7f18501991a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1838005910 tx=0x7f18380057d0 comp rx=0 tx=0).stop 2024-01-24T15:38:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:43.608+0000 7f1855200700 1 -- 172.21.15.5:0/3066531166 shutdown_connections 2024-01-24T15:38:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:43.608+0000 7f1855200700 1 --2- 172.21.15.5:0/3066531166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1850106ac0 0x7f18501a01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:38:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:43.608+0000 7f1855200700 1 --2- 172.21.15.5:0/3066531166 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1850101860 0x7f1850198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:38:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:43.608+0000 7f1855200700 1 --2- 172.21.15.5:0/3066531166 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f18300a05a0 0x7f18300a2a60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:38:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:43.608+0000 7f1855200700 1 --2- 172.21.15.5:0/3066531166 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1850104190 0x7f18501991a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:38:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:43.608+0000 7f1855200700 1 -- 172.21.15.5:0/3066531166 >> 172.21.15.5:0/3066531166 conn(0x7f18500fb250 msgr2=0x7f18500ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:38:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:43.608+0000 7f1855200700 1 -- 172.21.15.5:0/3066531166 shutdown_connections 2024-01-24T15:38:43.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:38:43.608+0000 7f1855200700 1 -- 172.21.15.5:0/3066531166 wait complete. 2024-01-24T15:38:43.986 DEBUG:teuthology.orchestra.run.smithi005:osd.9> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.9.service 2024-01-24T15:38:43.991 INFO:tasks.cephadm:Deploying osd.10 on smithi160 with /dev/vg_nvme/lv_1... 2024-01-24T15:38:43.991 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-01-24T15:38:44.065 INFO:journalctl@ceph.osd.9.smithi005.stdout:-- Logs begin at Wed 2024-01-24 15:16:42 UTC. -- 2024-01-24T15:38:44.182 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:43 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:44.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:43 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:44.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:43 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:44.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:43 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:38:44.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:43 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:44.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:43 smithi005 ceph-mon[35346]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-01-24T15:38:44.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:43 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:44.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:43 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:44.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:43 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:38:44.227 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:43 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:44.227 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:43 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:44.227 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:43 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:44.228 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:43 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:38:44.228 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:43 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:44.228 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:43 smithi204 ceph-mon[39634]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-01-24T15:38:44.228 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:43 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:44.228 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:43 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:44.228 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:43 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:38:44.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:43 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:44.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:43 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:44.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:43 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:44.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:43 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:38:44.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:43 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:44.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:43 smithi160 ceph-mon[38982]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-01-24T15:38:44.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:43 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:44.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:43 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:44.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:43 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:38:44.354 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.b/config 2024-01-24T15:38:45.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:45 smithi005 ceph-mon[35346]: from='osd.9 [v2:172.21.15.5:6826/2119772860,v1:172.21.15.5:6827/2119772860]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-01-24T15:38:45.434 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:38:45 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:38:45.018+0000 7fb579853640 -1 osd.9 0 log_to_monitors true 2024-01-24T15:38:45.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:45 smithi204 ceph-mon[39634]: from='osd.9 [v2:172.21.15.5:6826/2119772860,v1:172.21.15.5:6827/2119772860]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-01-24T15:38:45.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:45 smithi160 ceph-mon[38982]: from='osd.9 [v2:172.21.15.5:6826/2119772860,v1:172.21.15.5:6827/2119772860]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-01-24T15:38:45.911 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-01-24T15:38:45.912 INFO:teuthology.orchestra.run.smithi160.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-01-24T15:38:45.912 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10+0 records in 2024-01-24T15:38:45.912 INFO:teuthology.orchestra.run.smithi160.stderr:10+0 records out 2024-01-24T15:38:45.912 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0382218 s, 274 MB/s 2024-01-24T15:38:45.912 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping successful for: 2024-01-24T15:38:46.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:46 smithi160 ceph-mon[38982]: from='osd.9 [v2:172.21.15.5:6826/2119772860,v1:172.21.15.5:6827/2119772860]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-01-24T15:38:46.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:46 smithi160 ceph-mon[38982]: osdmap e63: 10 total, 9 up, 10 in 2024-01-24T15:38:46.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:46 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-24T15:38:46.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:46 smithi160 ceph-mon[38982]: from='osd.9 [v2:172.21.15.5:6826/2119772860,v1:172.21.15.5:6827/2119772860]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-01-24T15:38:46.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:46 smithi160 ceph-mon[38982]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2024-01-24T15:38:46.286 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph orch daemon add osd smithi160:vg_nvme/lv_1 2024-01-24T15:38:46.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:46 smithi005 ceph-mon[35346]: from='osd.9 [v2:172.21.15.5:6826/2119772860,v1:172.21.15.5:6827/2119772860]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-01-24T15:38:46.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:46 smithi005 ceph-mon[35346]: osdmap e63: 10 total, 9 up, 10 in 2024-01-24T15:38:46.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:46 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-24T15:38:46.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:46 smithi005 ceph-mon[35346]: from='osd.9 [v2:172.21.15.5:6826/2119772860,v1:172.21.15.5:6827/2119772860]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-01-24T15:38:46.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:46 smithi005 ceph-mon[35346]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2024-01-24T15:38:46.434 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:38:46 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:38:46.089+0000 7fb56d400700 -1 osd.9 0 waiting for initial osdmap 2024-01-24T15:38:46.434 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:38:46 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:38:46.111+0000 7fb563c00700 -1 osd.9 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T15:38:46.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:46 smithi204 ceph-mon[39634]: from='osd.9 [v2:172.21.15.5:6826/2119772860,v1:172.21.15.5:6827/2119772860]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-01-24T15:38:46.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:46 smithi204 ceph-mon[39634]: osdmap e63: 10 total, 9 up, 10 in 2024-01-24T15:38:46.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:46 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-24T15:38:46.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:46 smithi204 ceph-mon[39634]: from='osd.9 [v2:172.21.15.5:6826/2119772860,v1:172.21.15.5:6827/2119772860]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-01-24T15:38:46.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:46 smithi204 ceph-mon[39634]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2024-01-24T15:38:46.637 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.b/config 2024-01-24T15:38:47.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:47 smithi005 ceph-mon[35346]: from='osd.9 [v2:172.21.15.5:6826/2119772860,v1:172.21.15.5:6827/2119772860]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-01-24T15:38:47.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:47 smithi005 ceph-mon[35346]: osdmap e64: 10 total, 9 up, 10 in 2024-01-24T15:38:47.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:47 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-24T15:38:47.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:47 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-24T15:38:47.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:47 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:47.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:47 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:47.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:47 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:47.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:47 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:47.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:47 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:47.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:47 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:47.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:47 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:47.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:47 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:47.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:47 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:38:47.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:47 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:47.473 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:47 smithi160 ceph-mon[38982]: from='osd.9 [v2:172.21.15.5:6826/2119772860,v1:172.21.15.5:6827/2119772860]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-01-24T15:38:47.473 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:47 smithi160 ceph-mon[38982]: osdmap e64: 10 total, 9 up, 10 in 2024-01-24T15:38:47.473 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:47 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-24T15:38:47.473 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:47 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-24T15:38:47.473 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:47 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:47.473 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:47 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:47.473 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:47 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:47.474 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:47 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:47.474 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:47 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:47.474 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:47 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:47.474 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:47 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:47.474 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:47 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:47.474 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:47 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:38:47.474 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:47 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:47.474 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:47 smithi204 ceph-mon[39634]: from='osd.9 [v2:172.21.15.5:6826/2119772860,v1:172.21.15.5:6827/2119772860]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-01-24T15:38:47.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:47 smithi204 ceph-mon[39634]: osdmap e64: 10 total, 9 up, 10 in 2024-01-24T15:38:47.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:47 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-24T15:38:47.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:47 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-24T15:38:47.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:47 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:47.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:47 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:47.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:47 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:47.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:47 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:47.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:47 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:47.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:47 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:38:47.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:47 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:47.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:47 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:47.476 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:47 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:38:47.476 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:47 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:38:47.699 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.696+0000 7faa4cc00700 1 -- 172.21.15.160:0/3420657247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa48101fd0 msgr2=0x7faa48102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:38:47.699 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.696+0000 7faa4cc00700 1 --2- 172.21.15.160:0/3420657247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa48101fd0 0x7faa48102430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faa300099c0 tx=0x7faa30009cd0 comp rx=0 tx=0).stop 2024-01-24T15:38:47.699 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.696+0000 7faa4cc00700 1 -- 172.21.15.160:0/3420657247 shutdown_connections 2024-01-24T15:38:47.699 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.696+0000 7faa4cc00700 1 --2- 172.21.15.160:0/3420657247 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa48102970 0x7faa48109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:38:47.699 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.696+0000 7faa4cc00700 1 --2- 172.21.15.160:0/3420657247 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa48100dd0 0x7faa481011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:38:47.699 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.696+0000 7faa4cc00700 1 --2- 172.21.15.160:0/3420657247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa48101fd0 0x7faa48102430 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:38:47.700 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.696+0000 7faa4cc00700 1 -- 172.21.15.160:0/3420657247 >> 172.21.15.160:0/3420657247 conn(0x7faa480fc330 msgr2=0x7faa480fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:38:47.700 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.696+0000 7faa4cc00700 1 -- 172.21.15.160:0/3420657247 shutdown_connections 2024-01-24T15:38:47.700 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.696+0000 7faa4cc00700 1 -- 172.21.15.160:0/3420657247 wait complete. 2024-01-24T15:38:47.702 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.697+0000 7faa4cc00700 1 Processor -- start 2024-01-24T15:38:47.702 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.697+0000 7faa4cc00700 1 -- start start 2024-01-24T15:38:47.702 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.697+0000 7faa4cc00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa48100dd0 0x7faa48198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:38:47.702 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.697+0000 7faa4cc00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa48101fd0 0x7faa48199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:38:47.702 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.698+0000 7faa4cc00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa48102970 0x7faa481a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:38:47.702 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.698+0000 7faa4cc00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa481a0780 con 0x7faa48100dd0 2024-01-24T15:38:47.702 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.698+0000 7faa4cc00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa481a08c0 con 0x7faa48102970 2024-01-24T15:38:47.702 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.698+0000 7faa4cc00700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa481a0a80 con 0x7faa48101fd0 2024-01-24T15:38:47.702 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.698+0000 7faa45e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa48100dd0 0x7faa48198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:38:47.702 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.698+0000 7faa46800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa48102970 0x7faa481a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:38:47.702 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.698+0000 7faa45e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa48100dd0 0x7faa48198c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.160:56904/0 (socket says 172.21.15.160:56904) 2024-01-24T15:38:47.702 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.698+0000 7faa45e00700 1 -- 172.21.15.160:0/4089089164 learned_addr learned my addr 172.21.15.160:0/4089089164 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-01-24T15:38:47.703 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.698+0000 7faa45400700 1 --2- 172.21.15.160:0/4089089164 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa48101fd0 0x7faa48199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:38:47.703 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.698+0000 7faa46800700 1 -- 172.21.15.160:0/4089089164 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa48101fd0 msgr2=0x7faa48199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:38:47.703 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.698+0000 7faa46800700 1 --2- 172.21.15.160:0/4089089164 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa48101fd0 0x7faa48199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:38:47.703 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.698+0000 7faa46800700 1 -- 172.21.15.160:0/4089089164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa48100dd0 msgr2=0x7faa48198c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:38:47.703 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.698+0000 7faa46800700 1 --2- 172.21.15.160:0/4089089164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa48100dd0 0x7faa48198c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:38:47.703 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.698+0000 7faa46800700 1 -- 172.21.15.160:0/4089089164 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa300095f0 con 0x7faa48102970 2024-01-24T15:38:47.703 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.698+0000 7faa45e00700 1 --2- 172.21.15.160:0/4089089164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa48100dd0 0x7faa48198c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T15:38:47.703 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.698+0000 7faa46800700 1 --2- 172.21.15.160:0/4089089164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa48102970 0x7faa481a01b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faa40007f10 tx=0x7faa4000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:38:47.703 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.699+0000 7faa3ea00700 1 -- 172.21.15.160:0/4089089164 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4000ddd0 con 0x7faa48102970 2024-01-24T15:38:47.703 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.699+0000 7faa3ea00700 1 -- 172.21.15.160:0/4089089164 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faa4000f040 con 0x7faa48102970 2024-01-24T15:38:47.703 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.699+0000 7faa3ea00700 1 -- 172.21.15.160:0/4089089164 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa400059c0 con 0x7faa48102970 2024-01-24T15:38:47.703 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.699+0000 7faa4cc00700 1 -- 172.21.15.160:0/4089089164 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa481a0d60 con 0x7faa48102970 2024-01-24T15:38:47.703 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.699+0000 7faa4cc00700 1 -- 172.21.15.160:0/4089089164 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa481a11b0 con 0x7faa48102970 2024-01-24T15:38:47.704 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.700+0000 7faa4cc00700 1 -- 172.21.15.160:0/4089089164 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa4810c4d0 con 0x7faa48102970 2024-01-24T15:38:47.704 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.702+0000 7faa3ea00700 1 -- 172.21.15.160:0/4089089164 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7faa40005000 con 0x7faa48102970 2024-01-24T15:38:47.706 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.704+0000 7faa3ea00700 1 --2- 172.21.15.160:0/4089089164 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7faa280a0520 0x7faa280a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:38:47.706 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.704+0000 7faa3ea00700 1 -- 172.21.15.160:0/4089089164 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6261+0+0 (secure 0 0 0) 0x7faa400cb350 con 0x7faa48102970 2024-01-24T15:38:47.707 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.704+0000 7faa45e00700 1 --2- 172.21.15.160:0/4089089164 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7faa280a0520 0x7faa280a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:38:47.707 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.705+0000 7faa45e00700 1 --2- 172.21.15.160:0/4089089164 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7faa280a0520 0x7faa280a29e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faa4819a110 tx=0x7faa38009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:38:47.709 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.707+0000 7faa3ea00700 1 -- 172.21.15.160:0/4089089164 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7faa40095650 con 0x7faa48102970 2024-01-24T15:38:47.916 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:38:47.913+0000 7faa4cc00700 1 -- 172.21.15.160:0/4089089164 --> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7faa48108a00 con 0x7faa280a0520 2024-01-24T15:38:48.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:48 smithi005 ceph-mon[35346]: purged_snaps scrub starts 2024-01-24T15:38:48.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:48 smithi005 ceph-mon[35346]: purged_snaps scrub ok 2024-01-24T15:38:48.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:48 smithi005 ceph-mon[35346]: Detected new or changed devices on smithi005 2024-01-24T15:38:48.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:48 smithi005 ceph-mon[35346]: Adjusting osd_memory_target on smithi005 to 4319M 2024-01-24T15:38:48.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:48 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-24T15:38:48.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:48 smithi005 ceph-mon[35346]: osd.9 [v2:172.21.15.5:6826/2119772860,v1:172.21.15.5:6827/2119772860] boot 2024-01-24T15:38:48.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:48 smithi005 ceph-mon[35346]: osdmap e65: 10 total, 10 up, 10 in 2024-01-24T15:38:48.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:48 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-24T15:38:48.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:48 smithi005 ceph-mon[35346]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2024-01-24T15:38:48.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:48 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:38:48.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:48 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:38:48.434 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:48 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:48.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:48 smithi204 ceph-mon[39634]: purged_snaps scrub starts 2024-01-24T15:38:48.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:48 smithi204 ceph-mon[39634]: purged_snaps scrub ok 2024-01-24T15:38:48.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:48 smithi204 ceph-mon[39634]: Detected new or changed devices on smithi005 2024-01-24T15:38:48.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:48 smithi204 ceph-mon[39634]: Adjusting osd_memory_target on smithi005 to 4319M 2024-01-24T15:38:48.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:48 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-24T15:38:48.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:48 smithi204 ceph-mon[39634]: osd.9 [v2:172.21.15.5:6826/2119772860,v1:172.21.15.5:6827/2119772860] boot 2024-01-24T15:38:48.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:48 smithi204 ceph-mon[39634]: osdmap e65: 10 total, 10 up, 10 in 2024-01-24T15:38:48.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:48 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-24T15:38:48.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:48 smithi204 ceph-mon[39634]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2024-01-24T15:38:48.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:48 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:38:48.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:48 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:38:48.476 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:48 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:48.499 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:48 smithi160 ceph-mon[38982]: purged_snaps scrub starts 2024-01-24T15:38:48.499 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:48 smithi160 ceph-mon[38982]: purged_snaps scrub ok 2024-01-24T15:38:48.499 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:48 smithi160 ceph-mon[38982]: Detected new or changed devices on smithi005 2024-01-24T15:38:48.499 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:48 smithi160 ceph-mon[38982]: Adjusting osd_memory_target on smithi005 to 4319M 2024-01-24T15:38:48.499 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:48 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-24T15:38:48.499 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:48 smithi160 ceph-mon[38982]: osd.9 [v2:172.21.15.5:6826/2119772860,v1:172.21.15.5:6827/2119772860] boot 2024-01-24T15:38:48.499 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:48 smithi160 ceph-mon[38982]: osdmap e65: 10 total, 10 up, 10 in 2024-01-24T15:38:48.499 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:48 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-24T15:38:48.500 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:48 smithi160 ceph-mon[38982]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2024-01-24T15:38:48.500 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:48 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:38:48.500 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:48 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:38:48.500 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:48 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:49.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:49 smithi005 ceph-mon[35346]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:38:49.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:49 smithi005 ceph-mon[35346]: osdmap e66: 10 total, 10 up, 10 in 2024-01-24T15:38:49.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:49 smithi204 ceph-mon[39634]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:38:49.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:49 smithi204 ceph-mon[39634]: osdmap e66: 10 total, 10 up, 10 in 2024-01-24T15:38:49.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:49 smithi160 ceph-mon[38982]: from='client.24362 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:38:49.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:49 smithi160 ceph-mon[38982]: osdmap e66: 10 total, 10 up, 10 in 2024-01-24T15:38:50.432 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:50 smithi005 ceph-mon[35346]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:38:50.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:50 smithi204 ceph-mon[39634]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:38:50.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:50 smithi160 ceph-mon[38982]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:38:51.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:51 smithi005 ceph-mon[35346]: from='client.? 172.21.15.160:0/3955211697' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c22bfc5-3d41-491a-b862-18ef48485d36"}]: dispatch 2024-01-24T15:38:51.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:51 smithi005 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c22bfc5-3d41-491a-b862-18ef48485d36"}]: dispatch 2024-01-24T15:38:51.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:51 smithi005 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c22bfc5-3d41-491a-b862-18ef48485d36"}]': finished 2024-01-24T15:38:51.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:51 smithi005 ceph-mon[35346]: osdmap e67: 11 total, 10 up, 11 in 2024-01-24T15:38:51.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:51 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-24T15:38:51.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:51 smithi005 ceph-mon[35346]: from='client.? 172.21.15.160:0/4232611925' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:38:51.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:51 smithi204 ceph-mon[39634]: from='client.? 172.21.15.160:0/3955211697' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c22bfc5-3d41-491a-b862-18ef48485d36"}]: dispatch 2024-01-24T15:38:51.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:51 smithi204 ceph-mon[39634]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c22bfc5-3d41-491a-b862-18ef48485d36"}]: dispatch 2024-01-24T15:38:51.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:51 smithi204 ceph-mon[39634]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c22bfc5-3d41-491a-b862-18ef48485d36"}]': finished 2024-01-24T15:38:51.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:51 smithi204 ceph-mon[39634]: osdmap e67: 11 total, 10 up, 11 in 2024-01-24T15:38:51.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:51 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-24T15:38:51.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:51 smithi204 ceph-mon[39634]: from='client.? 172.21.15.160:0/4232611925' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:38:51.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:51 smithi160 ceph-mon[38982]: from='client.? 172.21.15.160:0/3955211697' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c22bfc5-3d41-491a-b862-18ef48485d36"}]: dispatch 2024-01-24T15:38:51.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:51 smithi160 ceph-mon[38982]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c22bfc5-3d41-491a-b862-18ef48485d36"}]: dispatch 2024-01-24T15:38:51.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:51 smithi160 ceph-mon[38982]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c22bfc5-3d41-491a-b862-18ef48485d36"}]': finished 2024-01-24T15:38:51.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:51 smithi160 ceph-mon[38982]: osdmap e67: 11 total, 10 up, 11 in 2024-01-24T15:38:51.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:51 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-24T15:38:51.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:51 smithi160 ceph-mon[38982]: from='client.? 172.21.15.160:0/4232611925' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:38:52.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:52 smithi005 ceph-mon[35346]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:38:52.474 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:52 smithi204 ceph-mon[39634]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:38:52.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:52 smithi160 ceph-mon[38982]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:38:54.546 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:54 smithi160 ceph-mon[38982]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:38:54.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:54 smithi005 ceph-mon[35346]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:38:54.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:54 smithi204 ceph-mon[39634]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:38:56.632 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:56 smithi160 ceph-mon[38982]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:38:56.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:56 smithi005 ceph-mon[35346]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:38:56.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:56 smithi204 ceph-mon[39634]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:38:57.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:57 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-01-24T15:38:57.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:57 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:57.706 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:57 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-01-24T15:38:57.707 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:57 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:57.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:57 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-01-24T15:38:57.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:57 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:38:58.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:58 smithi160 ceph-mon[38982]: Deploying daemon osd.10 on smithi160 2024-01-24T15:38:58.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:38:58 smithi160 ceph-mon[38982]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:38:58.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:58 smithi005 ceph-mon[35346]: Deploying daemon osd.10 on smithi160 2024-01-24T15:38:58.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:38:58 smithi005 ceph-mon[35346]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:38:58.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:58 smithi204 ceph-mon[39634]: Deploying daemon osd.10 on smithi160 2024-01-24T15:38:58.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:38:58 smithi204 ceph-mon[39634]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:39:00.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:00 smithi160 ceph-mon[38982]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:39:00.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:00 smithi005 ceph-mon[35346]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:39:00.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:00 smithi204 ceph-mon[39634]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:39:02.412 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:02 smithi160 ceph-mon[38982]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:39:02.412 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:02 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:02.412 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:02 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:39:02.412 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:02 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:02.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:02 smithi005 ceph-mon[35346]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:39:02.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:02 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:02.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:02 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:39:02.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:02 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:02.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:02 smithi204 ceph-mon[39634]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:39:02.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:02 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:02.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:02 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:39:02.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:02 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:04.384 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:39:04.379+0000 7faa3ea00700 1 -- 172.21.15.160:0/4089089164 <== mgr.14150 v2:172.21.15.5:6800/1971309753 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7faa48108a00 con 0x7faa280a0520 2024-01-24T15:39:04.384 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 10 on host 'smithi160' 2024-01-24T15:39:04.385 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:39:04.381+0000 7faa4cc00700 1 -- 172.21.15.160:0/4089089164 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7faa280a0520 msgr2=0x7faa280a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:04.385 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:39:04.381+0000 7faa4cc00700 1 --2- 172.21.15.160:0/4089089164 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7faa280a0520 0x7faa280a29e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faa4819a110 tx=0x7faa38009260 comp rx=0 tx=0).stop 2024-01-24T15:39:04.385 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:39:04.381+0000 7faa4cc00700 1 -- 172.21.15.160:0/4089089164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa48102970 msgr2=0x7faa481a01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:04.385 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:39:04.381+0000 7faa4cc00700 1 --2- 172.21.15.160:0/4089089164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa48102970 0x7faa481a01b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faa40007f10 tx=0x7faa4000d3b0 comp rx=0 tx=0).stop 2024-01-24T15:39:04.386 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:39:04.381+0000 7faa4cc00700 1 -- 172.21.15.160:0/4089089164 shutdown_connections 2024-01-24T15:39:04.386 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:39:04.381+0000 7faa4cc00700 1 --2- 172.21.15.160:0/4089089164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa48102970 0x7faa481a01b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:04.386 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:39:04.381+0000 7faa4cc00700 1 --2- 172.21.15.160:0/4089089164 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7faa280a0520 0x7faa280a29e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:04.386 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:39:04.381+0000 7faa4cc00700 1 --2- 172.21.15.160:0/4089089164 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faa48100dd0 0x7faa48198c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:04.386 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:39:04.381+0000 7faa4cc00700 1 --2- 172.21.15.160:0/4089089164 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7faa48101fd0 0x7faa48199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:04.386 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:39:04.381+0000 7faa4cc00700 1 -- 172.21.15.160:0/4089089164 >> 172.21.15.160:0/4089089164 conn(0x7faa480fc330 msgr2=0x7faa480fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:04.386 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:39:04.381+0000 7faa4cc00700 1 -- 172.21.15.160:0/4089089164 shutdown_connections 2024-01-24T15:39:04.386 INFO:teuthology.orchestra.run.smithi160.stderr:2024-01-24T15:39:04.381+0000 7faa4cc00700 1 -- 172.21.15.160:0/4089089164 wait complete. 2024-01-24T15:39:04.572 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:04 smithi160 ceph-mon[38982]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:39:04.572 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:04 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:04.572 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:04 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:04.572 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:04 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:04.572 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:04 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:39:04.573 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:04 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:04.573 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:04 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:04.573 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:04 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:04.573 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:04 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:39:04.758 DEBUG:teuthology.orchestra.run.smithi160:osd.10> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.10.service 2024-01-24T15:39:04.762 INFO:tasks.cephadm:Deploying osd.11 on smithi204 with /dev/vg_nvme/lv_1... 2024-01-24T15:39:04.762 DEBUG:teuthology.orchestra.run.smithi204:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-01-24T15:39:04.830 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:04 smithi204 ceph-mon[39634]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:39:04.830 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:04 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:04.830 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:04 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:04.830 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:04 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:04.830 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:04 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:39:04.830 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:04 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:04.830 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:04 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:04.830 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:04 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:04.830 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:04 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:39:04.838 INFO:journalctl@ceph.osd.10.smithi160.stdout:-- Logs begin at Wed 2024-01-24 15:17:12 UTC. -- 2024-01-24T15:39:04.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:04 smithi005 ceph-mon[35346]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:39:04.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:04 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:04.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:04 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:04.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:04 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:04.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:04 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:39:04.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:04 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:04.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:04 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:04.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:04 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:04.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:04 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:39:05.127 INFO:teuthology.orchestra.run.smithi204.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.c/config 2024-01-24T15:39:06.007 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:39:05 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:39:05.739+0000 7f870eefd640 -1 osd.10 0 log_to_monitors true 2024-01-24T15:39:06.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:06 smithi005 ceph-mon[35346]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:39:06.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:06 smithi005 ceph-mon[35346]: from='osd.10 [v2:172.21.15.160:6824/4035458661,v1:172.21.15.160:6825/4035458661]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-01-24T15:39:06.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:06 smithi005 ceph-mon[35346]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-01-24T15:39:06.969 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:06 smithi160 ceph-mon[38982]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:39:06.969 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:06 smithi160 ceph-mon[38982]: from='osd.10 [v2:172.21.15.160:6824/4035458661,v1:172.21.15.160:6825/4035458661]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-01-24T15:39:06.970 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:06 smithi160 ceph-mon[38982]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-01-24T15:39:06.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:06 smithi204 ceph-mon[39634]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:39:06.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:06 smithi204 ceph-mon[39634]: from='osd.10 [v2:172.21.15.160:6824/4035458661,v1:172.21.15.160:6825/4035458661]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-01-24T15:39:06.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:06 smithi204 ceph-mon[39634]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-01-24T15:39:06.996 INFO:teuthology.orchestra.run.smithi204.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-01-24T15:39:06.996 INFO:teuthology.orchestra.run.smithi204.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-01-24T15:39:06.996 INFO:teuthology.orchestra.run.smithi204.stderr: stderr: 10+0 records in 2024-01-24T15:39:06.996 INFO:teuthology.orchestra.run.smithi204.stderr:10+0 records out 2024-01-24T15:39:06.996 INFO:teuthology.orchestra.run.smithi204.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0301217 s, 348 MB/s 2024-01-24T15:39:06.996 INFO:teuthology.orchestra.run.smithi204.stderr:--> Zapping successful for: 2024-01-24T15:39:07.489 DEBUG:teuthology.orchestra.run.smithi204:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph orch daemon add osd smithi204:vg_nvme/lv_1 2024-01-24T15:39:07.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:07 smithi204 ceph-mon[39634]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-01-24T15:39:07.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:07 smithi204 ceph-mon[39634]: osdmap e68: 11 total, 10 up, 11 in 2024-01-24T15:39:07.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:07 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-24T15:39:07.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:07 smithi204 ceph-mon[39634]: from='osd.10 [v2:172.21.15.160:6824/4035458661,v1:172.21.15.160:6825/4035458661]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-01-24T15:39:07.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:07 smithi204 ceph-mon[39634]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-01-24T15:39:07.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:07 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:07.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:07 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:07.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:07 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:39:07.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:07 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:39:07.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:07 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:39:07.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:07 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:39:07.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:07 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:07.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:07 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:07.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:07 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:39:07.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:07 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:07.851 INFO:teuthology.orchestra.run.smithi204.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.c/config 2024-01-24T15:39:07.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:07 smithi005 ceph-mon[35346]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-01-24T15:39:07.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:07 smithi005 ceph-mon[35346]: osdmap e68: 11 total, 10 up, 11 in 2024-01-24T15:39:07.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:07 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-24T15:39:07.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:07 smithi005 ceph-mon[35346]: from='osd.10 [v2:172.21.15.160:6824/4035458661,v1:172.21.15.160:6825/4035458661]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-01-24T15:39:07.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:07 smithi005 ceph-mon[35346]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-01-24T15:39:07.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:07 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:07.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:07 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:07.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:07 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:39:07.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:07 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:39:07.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:07 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:39:07.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:07 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:39:07.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:07 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:07.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:07 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:07.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:07 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:39:07.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:07 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:08.007 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:39:07 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:39:07.586+0000 7f8702a00700 -1 osd.10 0 waiting for initial osdmap 2024-01-24T15:39:08.007 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:39:07 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:39:07.607+0000 7f86fa600700 -1 osd.10 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T15:39:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:07 smithi160 ceph-mon[38982]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-01-24T15:39:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:07 smithi160 ceph-mon[38982]: osdmap e68: 11 total, 10 up, 11 in 2024-01-24T15:39:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:07 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-24T15:39:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:07 smithi160 ceph-mon[38982]: from='osd.10 [v2:172.21.15.160:6824/4035458661,v1:172.21.15.160:6825/4035458661]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-01-24T15:39:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:07 smithi160 ceph-mon[38982]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-01-24T15:39:08.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:07 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:08.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:07 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:08.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:07 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:39:08.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:07 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:39:08.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:07 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:39:08.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:07 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:39:08.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:07 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:08.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:07 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:08.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:07 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:39:08.009 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:07 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:08.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:08 smithi005 ceph-mon[35346]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:39:08.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:08 smithi005 ceph-mon[35346]: Detected new or changed devices on smithi160 2024-01-24T15:39:08.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:08 smithi005 ceph-mon[35346]: Adjusting osd_memory_target on smithi160 to 4317M 2024-01-24T15:39:08.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:08 smithi005 ceph-mon[35346]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-01-24T15:39:08.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:08 smithi005 ceph-mon[35346]: osdmap e69: 11 total, 10 up, 11 in 2024-01-24T15:39:08.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:08 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-24T15:39:08.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:08 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-24T15:39:08.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:08 smithi005 ceph-mon[35346]: osd.10 [v2:172.21.15.160:6824/4035458661,v1:172.21.15.160:6825/4035458661] boot 2024-01-24T15:39:08.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:08 smithi005 ceph-mon[35346]: osdmap e70: 11 total, 11 up, 11 in 2024-01-24T15:39:08.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:08 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-24T15:39:08.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:08 smithi204 ceph-mon[39634]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:39:08.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:08 smithi204 ceph-mon[39634]: Detected new or changed devices on smithi160 2024-01-24T15:39:08.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:08 smithi204 ceph-mon[39634]: Adjusting osd_memory_target on smithi160 to 4317M 2024-01-24T15:39:08.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:08 smithi204 ceph-mon[39634]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-01-24T15:39:08.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:08 smithi204 ceph-mon[39634]: osdmap e69: 11 total, 10 up, 11 in 2024-01-24T15:39:08.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:08 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-24T15:39:08.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:08 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-24T15:39:08.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:08 smithi204 ceph-mon[39634]: osd.10 [v2:172.21.15.160:6824/4035458661,v1:172.21.15.160:6825/4035458661] boot 2024-01-24T15:39:08.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:08 smithi204 ceph-mon[39634]: osdmap e70: 11 total, 11 up, 11 in 2024-01-24T15:39:08.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:08 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-24T15:39:09.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:08 smithi160 ceph-mon[38982]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2024-01-24T15:39:09.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:08 smithi160 ceph-mon[38982]: Detected new or changed devices on smithi160 2024-01-24T15:39:09.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:08 smithi160 ceph-mon[38982]: Adjusting osd_memory_target on smithi160 to 4317M 2024-01-24T15:39:09.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:08 smithi160 ceph-mon[38982]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-01-24T15:39:09.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:08 smithi160 ceph-mon[38982]: osdmap e69: 11 total, 10 up, 11 in 2024-01-24T15:39:09.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:08 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-24T15:39:09.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:08 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-24T15:39:09.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:08 smithi160 ceph-mon[38982]: osd.10 [v2:172.21.15.160:6824/4035458661,v1:172.21.15.160:6825/4035458661] boot 2024-01-24T15:39:09.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:08 smithi160 ceph-mon[38982]: osdmap e70: 11 total, 11 up, 11 in 2024-01-24T15:39:09.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:08 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-24T15:39:09.254 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.251+0000 7f4bdd600700 1 -- 172.21.15.204:0/3376375264 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4bd8101fd0 msgr2=0x7f4bd8102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:09.254 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.251+0000 7f4bdd600700 1 --2- 172.21.15.204:0/3376375264 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4bd8101fd0 0x7f4bd8102430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0009990 tx=0x7f4bc0009ca0 comp rx=0 tx=0).stop 2024-01-24T15:39:09.254 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.251+0000 7f4bdd600700 1 -- 172.21.15.204:0/3376375264 shutdown_connections 2024-01-24T15:39:09.254 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.251+0000 7f4bdd600700 1 --2- 172.21.15.204:0/3376375264 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4bd8102970 0x7f4bd8109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:09.254 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.251+0000 7f4bdd600700 1 --2- 172.21.15.204:0/3376375264 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bd8100dd0 0x7f4bd81011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:09.255 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.251+0000 7f4bdd600700 1 --2- 172.21.15.204:0/3376375264 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4bd8101fd0 0x7f4bd8102430 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:09.255 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.251+0000 7f4bdd600700 1 -- 172.21.15.204:0/3376375264 >> 172.21.15.204:0/3376375264 conn(0x7f4bd80fc330 msgr2=0x7f4bd80fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:09.255 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.251+0000 7f4bdd600700 1 -- 172.21.15.204:0/3376375264 shutdown_connections 2024-01-24T15:39:09.255 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.251+0000 7f4bdd600700 1 -- 172.21.15.204:0/3376375264 wait complete. 2024-01-24T15:39:09.255 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.253+0000 7f4bdd600700 1 Processor -- start 2024-01-24T15:39:09.255 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.253+0000 7f4bdd600700 1 -- start start 2024-01-24T15:39:09.257 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.253+0000 7f4bdd600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4bd8100dd0 0x7f4bd8196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:09.257 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.253+0000 7f4bdd600700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4bd8101fd0 0x7f4bd8196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:09.257 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.253+0000 7f4bdd600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bd8102970 0x7f4bd819dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:09.257 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.253+0000 7f4bdd600700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd819e590 con 0x7f4bd8102970 2024-01-24T15:39:09.257 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.253+0000 7f4bdd600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd819e6d0 con 0x7f4bd8100dd0 2024-01-24T15:39:09.257 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.253+0000 7f4bdd600700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd819e860 con 0x7f4bd8101fd0 2024-01-24T15:39:09.257 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.254+0000 7f4bd6000700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4bd8101fd0 0x7f4bd8196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:09.257 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.254+0000 7f4bd6000700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4bd8101fd0 0x7f4bd8196f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:47196/0 (socket says 172.21.15.204:47196) 2024-01-24T15:39:09.257 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.254+0000 7f4bd6000700 1 -- 172.21.15.204:0/4068196958 learned_addr learned my addr 172.21.15.204:0/4068196958 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-01-24T15:39:09.257 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.254+0000 7f4bd6a00700 1 --2- 172.21.15.204:0/4068196958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4bd8100dd0 0x7f4bd8196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:09.257 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.254+0000 7f4bd7400700 1 --2- 172.21.15.204:0/4068196958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bd8102970 0x7f4bd819dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:09.257 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.254+0000 7f4bd6000700 1 -- 172.21.15.204:0/4068196958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4bd8100dd0 msgr2=0x7f4bd8196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:09.258 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.254+0000 7f4bd6000700 1 --2- 172.21.15.204:0/4068196958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4bd8100dd0 0x7f4bd8196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:09.258 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.254+0000 7f4bd6000700 1 -- 172.21.15.204:0/4068196958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bd8102970 msgr2=0x7f4bd819dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:09.258 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.254+0000 7f4bd6000700 1 --2- 172.21.15.204:0/4068196958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bd8102970 0x7f4bd819dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:09.258 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.254+0000 7f4bd6000700 1 -- 172.21.15.204:0/4068196958 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc00095f0 con 0x7f4bd8101fd0 2024-01-24T15:39:09.258 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.254+0000 7f4bd7400700 1 --2- 172.21.15.204:0/4068196958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bd8102970 0x7f4bd819dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T15:39:09.258 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.254+0000 7f4bd6000700 1 --2- 172.21.15.204:0/4068196958 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4bd8101fd0 0x7f4bd8196f40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0000c00 tx=0x7f4bc000bb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:09.259 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.255+0000 7f4bcf400700 1 -- 172.21.15.204:0/4068196958 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc001d070 con 0x7f4bd8101fd0 2024-01-24T15:39:09.259 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.255+0000 7f4bcf400700 1 -- 172.21.15.204:0/4068196958 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4bc0003d20 con 0x7f4bd8101fd0 2024-01-24T15:39:09.259 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.255+0000 7f4bcf400700 1 -- 172.21.15.204:0/4068196958 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0022e70 con 0x7f4bd8101fd0 2024-01-24T15:39:09.259 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.255+0000 7f4bdd600700 1 -- 172.21.15.204:0/4068196958 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd819eae0 con 0x7f4bd8101fd0 2024-01-24T15:39:09.259 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.255+0000 7f4bdd600700 1 -- 172.21.15.204:0/4068196958 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd819eef0 con 0x7f4bd8101fd0 2024-01-24T15:39:09.259 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.256+0000 7f4bdd600700 1 -- 172.21.15.204:0/4068196958 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd810c4d0 con 0x7f4bd8101fd0 2024-01-24T15:39:09.260 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.258+0000 7f4bcf400700 1 -- 172.21.15.204:0/4068196958 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f4bc0003890 con 0x7f4bd8101fd0 2024-01-24T15:39:09.261 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.259+0000 7f4bcf400700 1 --2- 172.21.15.204:0/4068196958 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f4bb80a0620 0x7f4bb80a2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:09.261 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.259+0000 7f4bcf400700 1 -- 172.21.15.204:0/4068196958 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6727+0+0 (secure 0 0 0) 0x7f4bc00cc820 con 0x7f4bd8101fd0 2024-01-24T15:39:09.262 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.259+0000 7f4bd6a00700 1 --2- 172.21.15.204:0/4068196958 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f4bb80a0620 0x7f4bb80a2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:09.262 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.260+0000 7f4bd6a00700 1 --2- 172.21.15.204:0/4068196958 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f4bb80a0620 0x7f4bb80a2ae0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8101e30 tx=0x7f4bc8007400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:09.265 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.263+0000 7f4bcf400700 1 -- 172.21.15.204:0/4068196958 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f4bc005d120 con 0x7f4bd8101fd0 2024-01-24T15:39:09.472 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:09.469+0000 7f4bdd600700 1 -- 172.21.15.204:0/4068196958 --> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi204:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4bd8061180 con 0x7f4bb80a0620 2024-01-24T15:39:09.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:09 smithi005 ceph-mon[35346]: purged_snaps scrub starts 2024-01-24T15:39:09.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:09 smithi005 ceph-mon[35346]: purged_snaps scrub ok 2024-01-24T15:39:09.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:09 smithi005 ceph-mon[35346]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2024-01-24T15:39:09.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:09 smithi005 ceph-mon[35346]: osdmap e71: 11 total, 11 up, 11 in 2024-01-24T15:39:09.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:09 smithi005 ceph-mon[35346]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi204:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:39:09.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:09 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:39:09.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:09 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:39:09.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:09 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:09.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:09 smithi204 ceph-mon[39634]: purged_snaps scrub starts 2024-01-24T15:39:09.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:09 smithi204 ceph-mon[39634]: purged_snaps scrub ok 2024-01-24T15:39:09.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:09 smithi204 ceph-mon[39634]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2024-01-24T15:39:09.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:09 smithi204 ceph-mon[39634]: osdmap e71: 11 total, 11 up, 11 in 2024-01-24T15:39:09.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:09 smithi204 ceph-mon[39634]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi204:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:39:09.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:09 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:39:09.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:09 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:39:09.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:09 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:10.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:09 smithi160 ceph-mon[38982]: purged_snaps scrub starts 2024-01-24T15:39:10.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:09 smithi160 ceph-mon[38982]: purged_snaps scrub ok 2024-01-24T15:39:10.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:09 smithi160 ceph-mon[38982]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2024-01-24T15:39:10.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:09 smithi160 ceph-mon[38982]: osdmap e71: 11 total, 11 up, 11 in 2024-01-24T15:39:10.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:09 smithi160 ceph-mon[38982]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi204:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:39:10.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:09 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-24T15:39:10.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:09 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-24T15:39:10.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:09 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:11.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:11 smithi005 ceph-mon[35346]: osdmap e72: 11 total, 11 up, 11 in 2024-01-24T15:39:11.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:11 smithi204 ceph-mon[39634]: osdmap e72: 11 total, 11 up, 11 in 2024-01-24T15:39:11.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:11 smithi160 ceph-mon[38982]: osdmap e72: 11 total, 11 up, 11 in 2024-01-24T15:39:12.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:12 smithi005 ceph-mon[35346]: pgmap v214: 1 pgs: 1 peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2024-01-24T15:39:12.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:12 smithi005 ceph-mon[35346]: osdmap e73: 11 total, 11 up, 11 in 2024-01-24T15:39:12.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:12 smithi005 ceph-mon[35346]: from='client.? 172.21.15.204:0/3803287098' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7b11c08-6aaa-4c9c-bf3e-794e0ed6a48b"}]: dispatch 2024-01-24T15:39:12.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:12 smithi005 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7b11c08-6aaa-4c9c-bf3e-794e0ed6a48b"}]: dispatch 2024-01-24T15:39:12.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:12 smithi005 ceph-mon[35346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7b11c08-6aaa-4c9c-bf3e-794e0ed6a48b"}]': finished 2024-01-24T15:39:12.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:12 smithi005 ceph-mon[35346]: osdmap e74: 12 total, 11 up, 12 in 2024-01-24T15:39:12.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:12 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-24T15:39:12.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:12 smithi204 ceph-mon[39634]: pgmap v214: 1 pgs: 1 peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2024-01-24T15:39:12.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:12 smithi204 ceph-mon[39634]: osdmap e73: 11 total, 11 up, 11 in 2024-01-24T15:39:12.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:12 smithi204 ceph-mon[39634]: from='client.? 172.21.15.204:0/3803287098' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7b11c08-6aaa-4c9c-bf3e-794e0ed6a48b"}]: dispatch 2024-01-24T15:39:12.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:12 smithi204 ceph-mon[39634]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7b11c08-6aaa-4c9c-bf3e-794e0ed6a48b"}]: dispatch 2024-01-24T15:39:12.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:12 smithi204 ceph-mon[39634]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7b11c08-6aaa-4c9c-bf3e-794e0ed6a48b"}]': finished 2024-01-24T15:39:12.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:12 smithi204 ceph-mon[39634]: osdmap e74: 12 total, 11 up, 12 in 2024-01-24T15:39:12.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:12 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-24T15:39:12.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:12 smithi160 ceph-mon[38982]: pgmap v214: 1 pgs: 1 peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2024-01-24T15:39:12.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:12 smithi160 ceph-mon[38982]: osdmap e73: 11 total, 11 up, 11 in 2024-01-24T15:39:12.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:12 smithi160 ceph-mon[38982]: from='client.? 172.21.15.204:0/3803287098' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7b11c08-6aaa-4c9c-bf3e-794e0ed6a48b"}]: dispatch 2024-01-24T15:39:12.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:12 smithi160 ceph-mon[38982]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7b11c08-6aaa-4c9c-bf3e-794e0ed6a48b"}]: dispatch 2024-01-24T15:39:12.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:12 smithi160 ceph-mon[38982]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7b11c08-6aaa-4c9c-bf3e-794e0ed6a48b"}]': finished 2024-01-24T15:39:12.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:12 smithi160 ceph-mon[38982]: osdmap e74: 12 total, 11 up, 12 in 2024-01-24T15:39:12.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:12 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-24T15:39:13.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:13 smithi005 ceph-mon[35346]: from='client.? 172.21.15.204:0/3459625548' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:39:13.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:13 smithi204 ceph-mon[39634]: from='client.? 172.21.15.204:0/3459625548' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:39:13.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:13 smithi160 ceph-mon[38982]: from='client.? 172.21.15.204:0/3459625548' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-24T15:39:14.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:14 smithi005 ceph-mon[35346]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-01-24T15:39:14.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:14 smithi204 ceph-mon[39634]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-01-24T15:39:14.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:14 smithi160 ceph-mon[38982]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-01-24T15:39:16.473 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:16 smithi204 ceph-mon[39634]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-01-24T15:39:16.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:16 smithi005 ceph-mon[35346]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-01-24T15:39:16.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:16 smithi160 ceph-mon[38982]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-01-24T15:39:18.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:18 smithi204 ceph-mon[39634]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-01-24T15:39:18.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:18 smithi005 ceph-mon[35346]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-01-24T15:39:18.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:18 smithi160 ceph-mon[38982]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-01-24T15:39:19.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:19 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-01-24T15:39:19.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:19 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:19.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:19 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-01-24T15:39:19.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:19 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:19.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:19 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-01-24T15:39:19.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:19 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:20.474 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:20 smithi204 ceph-mon[39634]: Deploying daemon osd.11 on smithi204 2024-01-24T15:39:20.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:20 smithi204 ceph-mon[39634]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-01-24T15:39:20.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:20 smithi005 ceph-mon[35346]: Deploying daemon osd.11 on smithi204 2024-01-24T15:39:20.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:20 smithi005 ceph-mon[35346]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-01-24T15:39:20.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:20 smithi160 ceph-mon[38982]: Deploying daemon osd.11 on smithi204 2024-01-24T15:39:20.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:20 smithi160 ceph-mon[38982]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-01-24T15:39:22.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:22 smithi005 ceph-mon[35346]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-01-24T15:39:22.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:22 smithi204 ceph-mon[39634]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-01-24T15:39:22.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:22 smithi160 ceph-mon[38982]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-01-24T15:39:24.601 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:24 smithi204 ceph-mon[39634]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-01-24T15:39:24.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:24 smithi005 ceph-mon[35346]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-01-24T15:39:24.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:24 smithi160 ceph-mon[38982]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-01-24T15:39:25.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:25 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:25.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:25 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:25.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:25 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:39:25.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:25 smithi005 ceph-mon[35346]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2024-01-24T15:39:25.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:25 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:25.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:25 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:25.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:25 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:39:25.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:25 smithi204 ceph-mon[39634]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2024-01-24T15:39:26.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:25 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:26.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:25 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:26.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:25 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:39:26.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:25 smithi160 ceph-mon[38982]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2024-01-24T15:39:27.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:27 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:27.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:27 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:27.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:27 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:27.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:27 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:39:27.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:27 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:27.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:27 smithi204 ceph-mon[39634]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2024-01-24T15:39:28.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:27 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:28.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:27 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:28.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:27 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:28.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:27 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:39:28.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:27 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:28.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:27 smithi160 ceph-mon[38982]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2024-01-24T15:39:28.144 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:28.142+0000 7f4bcf400700 1 -- 172.21.15.204:0/4068196958 <== mgr.14150 v2:172.21.15.5:6800/1971309753 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f4bd8061180 con 0x7f4bb80a0620 2024-01-24T15:39:28.144 INFO:teuthology.orchestra.run.smithi204.stdout:Created osd(s) 11 on host 'smithi204' 2024-01-24T15:39:28.147 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:28.145+0000 7f4bdd600700 1 -- 172.21.15.204:0/4068196958 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f4bb80a0620 msgr2=0x7f4bb80a2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:28.147 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:28.145+0000 7f4bdd600700 1 --2- 172.21.15.204:0/4068196958 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f4bb80a0620 0x7f4bb80a2ae0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8101e30 tx=0x7f4bc8007400 comp rx=0 tx=0).stop 2024-01-24T15:39:28.148 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:28.145+0000 7f4bdd600700 1 -- 172.21.15.204:0/4068196958 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4bd8101fd0 msgr2=0x7f4bd8196f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:28.148 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:28.145+0000 7f4bdd600700 1 --2- 172.21.15.204:0/4068196958 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4bd8101fd0 0x7f4bd8196f40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0000c00 tx=0x7f4bc000bb20 comp rx=0 tx=0).stop 2024-01-24T15:39:28.148 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:28.145+0000 7f4bdd600700 1 -- 172.21.15.204:0/4068196958 shutdown_connections 2024-01-24T15:39:28.148 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:28.145+0000 7f4bdd600700 1 --2- 172.21.15.204:0/4068196958 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f4bb80a0620 0x7f4bb80a2ae0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:28.148 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:28.145+0000 7f4bdd600700 1 --2- 172.21.15.204:0/4068196958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4bd8102970 0x7f4bd819dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:28.148 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:28.145+0000 7f4bdd600700 1 --2- 172.21.15.204:0/4068196958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4bd8100dd0 0x7f4bd8196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:28.148 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:28.145+0000 7f4bdd600700 1 --2- 172.21.15.204:0/4068196958 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f4bd8101fd0 0x7f4bd8196f40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:28.148 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:28.145+0000 7f4bdd600700 1 -- 172.21.15.204:0/4068196958 >> 172.21.15.204:0/4068196958 conn(0x7f4bd80fc330 msgr2=0x7f4bd80fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:28.148 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:28.145+0000 7f4bdd600700 1 -- 172.21.15.204:0/4068196958 shutdown_connections 2024-01-24T15:39:28.148 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:28.145+0000 7f4bdd600700 1 -- 172.21.15.204:0/4068196958 wait complete. 2024-01-24T15:39:28.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:27 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:28.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:27 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:28.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:27 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:28.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:27 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:39:28.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:27 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:28.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:27 smithi005 ceph-mon[35346]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2024-01-24T15:39:28.620 DEBUG:teuthology.orchestra.run.smithi204:osd.11> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.11.service 2024-01-24T15:39:28.624 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-01-24T15:39:28.624 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph osd stat -f json 2024-01-24T15:39:28.701 INFO:journalctl@ceph.osd.11.smithi204.stdout:-- Logs begin at Wed 2024-01-24 15:17:05 UTC. -- 2024-01-24T15:39:29.000 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.a/config 2024-01-24T15:39:29.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:29 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:29.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:29 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:39:29.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:29 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:29.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:29 smithi204 ceph-mon[39634]: from='osd.11 [v2:172.21.15.204:6824/1270764757,v1:172.21.15.204:6825/1270764757]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-01-24T15:39:29.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:29 smithi204 ceph-mon[39634]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-01-24T15:39:29.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:29 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:29.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:29 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:39:29.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:29 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:29.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:29 smithi005 ceph-mon[35346]: from='osd.11 [v2:172.21.15.204:6824/1270764757,v1:172.21.15.204:6825/1270764757]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-01-24T15:39:29.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:29 smithi005 ceph-mon[35346]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-01-24T15:39:29.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:29 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:29.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:29 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:39:29.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:29 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:29.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:29 smithi160 ceph-mon[38982]: from='osd.11 [v2:172.21.15.204:6824/1270764757,v1:172.21.15.204:6825/1270764757]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-01-24T15:39:29.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:29 smithi160 ceph-mon[38982]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-01-24T15:39:30.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.187+0000 7f8292200700 1 -- 172.21.15.5:0/4246617449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f828c101fd0 msgr2=0x7f828c102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:30.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.187+0000 7f8292200700 1 --2- 172.21.15.5:0/4246617449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f828c101fd0 0x7f828c102430 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f82740099c0 tx=0x7f8274009cd0 comp rx=0 tx=0).stop 2024-01-24T15:39:30.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.187+0000 7f8292200700 1 -- 172.21.15.5:0/4246617449 shutdown_connections 2024-01-24T15:39:30.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.187+0000 7f8292200700 1 --2- 172.21.15.5:0/4246617449 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f828c102970 0x7f828c109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:30.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.187+0000 7f8292200700 1 --2- 172.21.15.5:0/4246617449 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f828c100dd0 0x7f828c1011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:30.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.187+0000 7f8292200700 1 --2- 172.21.15.5:0/4246617449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f828c101fd0 0x7f828c102430 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:30.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.187+0000 7f8292200700 1 -- 172.21.15.5:0/4246617449 >> 172.21.15.5:0/4246617449 conn(0x7f828c0fc330 msgr2=0x7f828c0fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:30.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.187+0000 7f8292200700 1 -- 172.21.15.5:0/4246617449 shutdown_connections 2024-01-24T15:39:30.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.187+0000 7f8292200700 1 -- 172.21.15.5:0/4246617449 wait complete. 2024-01-24T15:39:30.192 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.188+0000 7f8292200700 1 Processor -- start 2024-01-24T15:39:30.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.188+0000 7f8292200700 1 -- start start 2024-01-24T15:39:30.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.189+0000 7f8292200700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f828c100dd0 0x7f828c198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:30.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.189+0000 7f8292200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f828c101fd0 0x7f828c1990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:30.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.189+0000 7f8292200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f828c102970 0x7f828c1a0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:30.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.189+0000 7f8292200700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c1a0710 con 0x7f828c102970 2024-01-24T15:39:30.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.189+0000 7f8292200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c1a0850 con 0x7f828c101fd0 2024-01-24T15:39:30.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.189+0000 7f8292200700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c1a09e0 con 0x7f828c100dd0 2024-01-24T15:39:30.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.189+0000 7f828b400700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f828c100dd0 0x7f828c198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:30.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.189+0000 7f828be00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f828c102970 0x7f828c1a0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:30.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.189+0000 7f828b400700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f828c100dd0 0x7f828c198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.5:59406/0 (socket says 172.21.15.5:59406) 2024-01-24T15:39:30.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.189+0000 7f828b400700 1 -- 172.21.15.5:0/3176206789 learned_addr learned my addr 172.21.15.5:0/3176206789 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:39:30.193 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.189+0000 7f828aa00700 1 --2- 172.21.15.5:0/3176206789 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f828c101fd0 0x7f828c1990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:30.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.189+0000 7f828b400700 1 -- 172.21.15.5:0/3176206789 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f828c101fd0 msgr2=0x7f828c1990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:30.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.189+0000 7f828b400700 1 --2- 172.21.15.5:0/3176206789 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f828c101fd0 0x7f828c1990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:30.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.189+0000 7f828b400700 1 -- 172.21.15.5:0/3176206789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f828c102970 msgr2=0x7f828c1a0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:30.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.189+0000 7f828b400700 1 --2- 172.21.15.5:0/3176206789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f828c102970 0x7f828c1a0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:30.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.189+0000 7f828b400700 1 -- 172.21.15.5:0/3176206789 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82740095f0 con 0x7f828c100dd0 2024-01-24T15:39:30.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.189+0000 7f828be00700 1 --2- 172.21.15.5:0/3176206789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f828c102970 0x7f828c1a0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T15:39:30.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.190+0000 7f828b400700 1 --2- 172.21.15.5:0/3176206789 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f828c100dd0 0x7f828c198b80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f827c00e9a0 tx=0x7f827c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:30.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.190+0000 7f8283e00700 1 -- 172.21.15.5:0/3176206789 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c009790 con 0x7f828c100dd0 2024-01-24T15:39:30.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.190+0000 7f8283e00700 1 -- 172.21.15.5:0/3176206789 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f827c00c810 con 0x7f828c100dd0 2024-01-24T15:39:30.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.190+0000 7f8292200700 1 -- 172.21.15.5:0/3176206789 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828c1a0cc0 con 0x7f828c100dd0 2024-01-24T15:39:30.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.190+0000 7f8283e00700 1 -- 172.21.15.5:0/3176206789 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c003bd0 con 0x7f828c100dd0 2024-01-24T15:39:30.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.190+0000 7f8292200700 1 -- 172.21.15.5:0/3176206789 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828c1a11c0 con 0x7f828c100dd0 2024-01-24T15:39:30.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.191+0000 7f8292200700 1 -- 172.21.15.5:0/3176206789 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828c10c4d0 con 0x7f828c100dd0 2024-01-24T15:39:30.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.193+0000 7f8283e00700 1 -- 172.21.15.5:0/3176206789 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f827c00c980 con 0x7f828c100dd0 2024-01-24T15:39:30.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.194+0000 7f8283e00700 1 --2- 172.21.15.5:0/3176206789 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f826c0a0520 0x7f826c0a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:30.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.194+0000 7f8283e00700 1 -- 172.21.15.5:0/3176206789 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6831+0+0 (secure 0 0 0) 0x7f827c014070 con 0x7f828c100dd0 2024-01-24T15:39:30.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.195+0000 7f828aa00700 1 --2- 172.21.15.5:0/3176206789 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f826c0a0520 0x7f826c0a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:30.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.195+0000 7f828aa00700 1 --2- 172.21.15.5:0/3176206789 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f826c0a0520 0x7f826c0a29e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8274006010 tx=0x7f827400bfd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:30.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.201+0000 7f8283e00700 1 -- 172.21.15.5:0/3176206789 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f827c0957a0 con 0x7f828c100dd0 2024-01-24T15:39:30.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.414+0000 7f8292200700 1 -- 172.21.15.5:0/3176206789 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f828c10c6c0 con 0x7f828c100dd0 2024-01-24T15:39:30.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.415+0000 7f8283e00700 1 -- 172.21.15.5:0/3176206789 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) v1 ==== 74+0+133 (secure 0 0 0) 0x7f827c098dc0 con 0x7f828c100dd0 2024-01-24T15:39:30.418 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:39:30.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.417+0000 7f8292200700 1 -- 172.21.15.5:0/3176206789 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f826c0a0520 msgr2=0x7f826c0a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:30.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.417+0000 7f8292200700 1 --2- 172.21.15.5:0/3176206789 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f826c0a0520 0x7f826c0a29e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8274006010 tx=0x7f827400bfd0 comp rx=0 tx=0).stop 2024-01-24T15:39:30.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.417+0000 7f8292200700 1 -- 172.21.15.5:0/3176206789 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f828c100dd0 msgr2=0x7f828c198b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:30.420 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.417+0000 7f8292200700 1 --2- 172.21.15.5:0/3176206789 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f828c100dd0 0x7f828c198b80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f827c00e9a0 tx=0x7f827c00ecb0 comp rx=0 tx=0).stop 2024-01-24T15:39:30.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.417+0000 7f8292200700 1 -- 172.21.15.5:0/3176206789 shutdown_connections 2024-01-24T15:39:30.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.417+0000 7f8292200700 1 --2- 172.21.15.5:0/3176206789 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f826c0a0520 0x7f826c0a29e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:30.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.417+0000 7f8292200700 1 --2- 172.21.15.5:0/3176206789 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f828c102970 0x7f828c1a0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:30.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.417+0000 7f8292200700 1 --2- 172.21.15.5:0/3176206789 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f828c100dd0 0x7f828c198b80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:30.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.417+0000 7f8292200700 1 --2- 172.21.15.5:0/3176206789 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f828c101fd0 0x7f828c1990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:30.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.417+0000 7f8292200700 1 -- 172.21.15.5:0/3176206789 >> 172.21.15.5:0/3176206789 conn(0x7f828c0fc330 msgr2=0x7f828c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:30.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.418+0000 7f8292200700 1 -- 172.21.15.5:0/3176206789 shutdown_connections 2024-01-24T15:39:30.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:30.418+0000 7f8292200700 1 -- 172.21.15.5:0/3176206789 wait complete. 2024-01-24T15:39:30.595 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:30 smithi005 ceph-mon[35346]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2024-01-24T15:39:30.595 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:30 smithi005 ceph-mon[35346]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-01-24T15:39:30.596 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:30 smithi005 ceph-mon[35346]: osdmap e75: 12 total, 11 up, 12 in 2024-01-24T15:39:30.596 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:30 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-24T15:39:30.596 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:30 smithi005 ceph-mon[35346]: from='osd.11 [v2:172.21.15.204:6824/1270764757,v1:172.21.15.204:6825/1270764757]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]: dispatch 2024-01-24T15:39:30.596 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:30 smithi005 ceph-mon[35346]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]: dispatch 2024-01-24T15:39:30.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:30 smithi204 ceph-mon[39634]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2024-01-24T15:39:30.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:30 smithi204 ceph-mon[39634]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-01-24T15:39:30.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:30 smithi204 ceph-mon[39634]: osdmap e75: 12 total, 11 up, 12 in 2024-01-24T15:39:30.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:30 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-24T15:39:30.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:30 smithi204 ceph-mon[39634]: from='osd.11 [v2:172.21.15.204:6824/1270764757,v1:172.21.15.204:6825/1270764757]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]: dispatch 2024-01-24T15:39:30.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:30 smithi204 ceph-mon[39634]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]: dispatch 2024-01-24T15:39:30.726 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:39:30 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:39:30.305+0000 7fa754c00700 -1 osd.11 0 waiting for initial osdmap 2024-01-24T15:39:30.726 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:39:30 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:39:30.327+0000 7fa74e600700 -1 osd.11 76 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-24T15:39:30.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:30 smithi160 ceph-mon[38982]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2024-01-24T15:39:30.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:30 smithi160 ceph-mon[38982]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-01-24T15:39:30.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:30 smithi160 ceph-mon[38982]: osdmap e75: 12 total, 11 up, 12 in 2024-01-24T15:39:30.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:30 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-24T15:39:30.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:30 smithi160 ceph-mon[38982]: from='osd.11 [v2:172.21.15.204:6824/1270764757,v1:172.21.15.204:6825/1270764757]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]: dispatch 2024-01-24T15:39:30.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:30 smithi160 ceph-mon[38982]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]: dispatch 2024-01-24T15:39:30.818 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":76,"num_osds":12,"num_up_osds":11,"osd_up_since":1706110748,"num_in_osds":12,"osd_in_since":1706110751,"num_remapped_pgs":0} 2024-01-24T15:39:31.474 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:31 smithi204 ceph-mon[39634]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]': finished 2024-01-24T15:39:31.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:31 smithi204 ceph-mon[39634]: osdmap e76: 12 total, 11 up, 12 in 2024-01-24T15:39:31.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:31 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-24T15:39:31.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:31 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-24T15:39:31.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:31 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/3176206789' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-24T15:39:31.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:31 smithi005 ceph-mon[35346]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]': finished 2024-01-24T15:39:31.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:31 smithi005 ceph-mon[35346]: osdmap e76: 12 total, 11 up, 12 in 2024-01-24T15:39:31.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:31 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-24T15:39:31.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:31 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-24T15:39:31.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:31 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/3176206789' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-24T15:39:31.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:31 smithi160 ceph-mon[38982]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi204", "root=default"]}]': finished 2024-01-24T15:39:31.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:31 smithi160 ceph-mon[38982]: osdmap e76: 12 total, 11 up, 12 in 2024-01-24T15:39:31.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:31 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-24T15:39:31.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:31 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-24T15:39:31.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:31 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/3176206789' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-24T15:39:31.819 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph osd stat -f json 2024-01-24T15:39:32.181 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.a/config 2024-01-24T15:39:32.653 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:32 smithi005 ceph-mon[35346]: purged_snaps scrub starts 2024-01-24T15:39:32.653 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:32 smithi005 ceph-mon[35346]: purged_snaps scrub ok 2024-01-24T15:39:32.653 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:32 smithi005 ceph-mon[35346]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2024-01-24T15:39:32.654 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:32 smithi005 ceph-mon[35346]: osd.11 [v2:172.21.15.204:6824/1270764757,v1:172.21.15.204:6825/1270764757] boot 2024-01-24T15:39:32.654 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:32 smithi005 ceph-mon[35346]: osdmap e77: 12 total, 12 up, 12 in 2024-01-24T15:39:32.654 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-24T15:39:32.654 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:32 smithi005 ceph-mon[35346]: Detected new or changed devices on smithi204 2024-01-24T15:39:32.654 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:32.654 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:32.654 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:39:32.654 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:39:32.654 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:39:32.654 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:39:32.654 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:32.654 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:32.654 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:39:32.655 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:32 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:32 smithi204 ceph-mon[39634]: purged_snaps scrub starts 2024-01-24T15:39:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:32 smithi204 ceph-mon[39634]: purged_snaps scrub ok 2024-01-24T15:39:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:32 smithi204 ceph-mon[39634]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2024-01-24T15:39:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:32 smithi204 ceph-mon[39634]: osd.11 [v2:172.21.15.204:6824/1270764757,v1:172.21.15.204:6825/1270764757] boot 2024-01-24T15:39:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:32 smithi204 ceph-mon[39634]: osdmap e77: 12 total, 12 up, 12 in 2024-01-24T15:39:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-24T15:39:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:32 smithi204 ceph-mon[39634]: Detected new or changed devices on smithi204 2024-01-24T15:39:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:32.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:32.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:39:32.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:39:32.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:39:32.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:39:32.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:32.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:32.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:39:32.726 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:32 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:32.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:32 smithi160 ceph-mon[38982]: purged_snaps scrub starts 2024-01-24T15:39:32.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:32 smithi160 ceph-mon[38982]: purged_snaps scrub ok 2024-01-24T15:39:32.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:32 smithi160 ceph-mon[38982]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2024-01-24T15:39:32.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:32 smithi160 ceph-mon[38982]: osd.11 [v2:172.21.15.204:6824/1270764757,v1:172.21.15.204:6825/1270764757] boot 2024-01-24T15:39:32.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:32 smithi160 ceph-mon[38982]: osdmap e77: 12 total, 12 up, 12 in 2024-01-24T15:39:32.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-24T15:39:32.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:32 smithi160 ceph-mon[38982]: Detected new or changed devices on smithi204 2024-01-24T15:39:32.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:32.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:32.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:39:32.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:39:32.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:39:32.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-01-24T15:39:32.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:32.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:32.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:39:32.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:32 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:33.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.311+0000 7f67a5800700 1 -- 172.21.15.5:0/3504264491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67a0101860 msgr2=0x7f67a0103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:33.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.311+0000 7f67a5800700 1 --2- 172.21.15.5:0/3504264491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67a0101860 0x7f67a0103c50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6790009990 tx=0x7f6790009ca0 comp rx=0 tx=0).stop 2024-01-24T15:39:33.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.311+0000 7f67a5800700 1 -- 172.21.15.5:0/3504264491 shutdown_connections 2024-01-24T15:39:33.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.311+0000 7f67a5800700 1 --2- 172.21.15.5:0/3504264491 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67a0106ac0 0x7f67a0108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:33.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.311+0000 7f67a5800700 1 --2- 172.21.15.5:0/3504264491 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67a0101860 0x7f67a0103c50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:33.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.311+0000 7f67a5800700 1 --2- 172.21.15.5:0/3504264491 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67a0104190 0x7f67a0106580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:33.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.311+0000 7f67a5800700 1 -- 172.21.15.5:0/3504264491 >> 172.21.15.5:0/3504264491 conn(0x7f67a00fb250 msgr2=0x7f67a00fd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:33.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.311+0000 7f67a5800700 1 -- 172.21.15.5:0/3504264491 shutdown_connections 2024-01-24T15:39:33.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.311+0000 7f67a5800700 1 -- 172.21.15.5:0/3504264491 wait complete. 2024-01-24T15:39:33.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.313+0000 7f67a5800700 1 Processor -- start 2024-01-24T15:39:33.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.313+0000 7f67a5800700 1 -- start start 2024-01-24T15:39:33.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.313+0000 7f67a5800700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67a0101860 0x7f67a0196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:33.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.313+0000 7f67a5800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67a0104190 0x7f67a0196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:33.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.313+0000 7f67a5800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67a0106ac0 0x7f67a019dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:33.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.313+0000 7f67a5800700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a019e5a0 con 0x7f67a0106ac0 2024-01-24T15:39:33.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.313+0000 7f67a5800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a019e6e0 con 0x7f67a0104190 2024-01-24T15:39:33.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.313+0000 7f67a5800700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a019e870 con 0x7f67a0101860 2024-01-24T15:39:33.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.314+0000 7f679e000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67a0104190 0x7f67a0196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:33.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.314+0000 7f679ea00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67a0101860 0x7f67a0196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:33.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.314+0000 7f679e000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67a0104190 0x7f67a0196f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.5:49398/0 (socket says 172.21.15.5:49398) 2024-01-24T15:39:33.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.314+0000 7f679f400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67a0106ac0 0x7f67a019dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:33.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.314+0000 7f679ea00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67a0101860 0x7f67a0196a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.5:47522/0 (socket says 172.21.15.5:47522) 2024-01-24T15:39:33.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.314+0000 7f679e000700 1 -- 172.21.15.5:0/3150381217 learned_addr learned my addr 172.21.15.5:0/3150381217 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:39:33.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.314+0000 7f679e000700 1 -- 172.21.15.5:0/3150381217 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67a0101860 msgr2=0x7f67a0196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:33.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.314+0000 7f679e000700 1 --2- 172.21.15.5:0/3150381217 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67a0101860 0x7f67a0196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:33.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.314+0000 7f679e000700 1 -- 172.21.15.5:0/3150381217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67a0106ac0 msgr2=0x7f67a019dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:33.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.314+0000 7f679e000700 1 --2- 172.21.15.5:0/3150381217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67a0106ac0 0x7f67a019dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:33.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.314+0000 7f679e000700 1 -- 172.21.15.5:0/3150381217 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67900095f0 con 0x7f67a0104190 2024-01-24T15:39:33.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.314+0000 7f679ea00700 1 --2- 172.21.15.5:0/3150381217 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67a0101860 0x7f67a0196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T15:39:33.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.315+0000 7f679e000700 1 --2- 172.21.15.5:0/3150381217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67a0104190 0x7f67a0196f50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f678800e9a0 tx=0x7f678800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:33.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.315+0000 7f6797400700 1 -- 172.21.15.5:0/3150381217 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6788009790 con 0x7f67a0104190 2024-01-24T15:39:33.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.315+0000 7f6797400700 1 -- 172.21.15.5:0/3150381217 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6788010430 con 0x7f67a0104190 2024-01-24T15:39:33.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.315+0000 7f6797400700 1 -- 172.21.15.5:0/3150381217 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678800cea0 con 0x7f67a0104190 2024-01-24T15:39:33.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.315+0000 7f67a5800700 1 -- 172.21.15.5:0/3150381217 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a019eb50 con 0x7f67a0104190 2024-01-24T15:39:33.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.315+0000 7f67a5800700 1 -- 172.21.15.5:0/3150381217 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a019f000 con 0x7f67a0104190 2024-01-24T15:39:33.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.316+0000 7f67a5800700 1 -- 172.21.15.5:0/3150381217 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67a00fcdd0 con 0x7f67a0104190 2024-01-24T15:39:33.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.319+0000 7f6797400700 1 -- 172.21.15.5:0/3150381217 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f67880105a0 con 0x7f67a0104190 2024-01-24T15:39:33.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.319+0000 7f6797400700 1 --2- 172.21.15.5:0/3150381217 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f67800a0520 0x7f67800a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:33.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.320+0000 7f6797400700 1 -- 172.21.15.5:0/3150381217 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6788014070 con 0x7f67a0104190 2024-01-24T15:39:33.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.320+0000 7f679ea00700 1 --2- 172.21.15.5:0/3150381217 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f67800a0520 0x7f67800a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:33.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.320+0000 7f679ea00700 1 --2- 172.21.15.5:0/3150381217 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f67800a0520 0x7f67800a29e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6790006010 tx=0x7f679000b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:33.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.322+0000 7f6797400700 1 -- 172.21.15.5:0/3150381217 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f6788095970 con 0x7f67a0104190 2024-01-24T15:39:33.432 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:33 smithi005 ceph-mon[35346]: Adjusting osd_memory_target on smithi204 to 4317M 2024-01-24T15:39:33.432 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:33 smithi005 ceph-mon[35346]: osdmap e78: 12 total, 12 up, 12 in 2024-01-24T15:39:33.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.531+0000 7f67a5800700 1 -- 172.21.15.5:0/3150381217 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f67a002cc70 con 0x7f67a0104190 2024-01-24T15:39:33.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.532+0000 7f6797400700 1 -- 172.21.15.5:0/3150381217 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v78) v1 ==== 74+0+133 (secure 0 0 0) 0x7f6788098f90 con 0x7f67a0104190 2024-01-24T15:39:33.534 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:39:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.534+0000 7f67a5800700 1 -- 172.21.15.5:0/3150381217 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f67800a0520 msgr2=0x7f67800a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.534+0000 7f67a5800700 1 --2- 172.21.15.5:0/3150381217 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f67800a0520 0x7f67800a29e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6790006010 tx=0x7f679000b260 comp rx=0 tx=0).stop 2024-01-24T15:39:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.534+0000 7f67a5800700 1 -- 172.21.15.5:0/3150381217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67a0104190 msgr2=0x7f67a0196f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.534+0000 7f67a5800700 1 --2- 172.21.15.5:0/3150381217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67a0104190 0x7f67a0196f50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f678800e9a0 tx=0x7f678800ecb0 comp rx=0 tx=0).stop 2024-01-24T15:39:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.534+0000 7f67a5800700 1 -- 172.21.15.5:0/3150381217 shutdown_connections 2024-01-24T15:39:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.534+0000 7f67a5800700 1 --2- 172.21.15.5:0/3150381217 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f67800a0520 0x7f67800a29e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.534+0000 7f67a5800700 1 --2- 172.21.15.5:0/3150381217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67a0106ac0 0x7f67a019dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.534+0000 7f67a5800700 1 --2- 172.21.15.5:0/3150381217 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f67a0101860 0x7f67a0196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.534+0000 7f67a5800700 1 --2- 172.21.15.5:0/3150381217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67a0104190 0x7f67a0196f50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:33.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.534+0000 7f67a5800700 1 -- 172.21.15.5:0/3150381217 >> 172.21.15.5:0/3150381217 conn(0x7f67a00fb250 msgr2=0x7f67a01024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:33.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.534+0000 7f67a5800700 1 -- 172.21.15.5:0/3150381217 shutdown_connections 2024-01-24T15:39:33.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:33.534+0000 7f67a5800700 1 -- 172.21.15.5:0/3150381217 wait complete. 2024-01-24T15:39:33.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:33 smithi204 ceph-mon[39634]: Adjusting osd_memory_target on smithi204 to 4317M 2024-01-24T15:39:33.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:33 smithi204 ceph-mon[39634]: osdmap e78: 12 total, 12 up, 12 in 2024-01-24T15:39:33.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:33 smithi160 ceph-mon[38982]: Adjusting osd_memory_target on smithi204 to 4317M 2024-01-24T15:39:33.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:33 smithi160 ceph-mon[38982]: osdmap e78: 12 total, 12 up, 12 in 2024-01-24T15:39:33.935 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":78,"num_osds":12,"num_up_osds":12,"osd_up_since":1706110771,"num_in_osds":12,"osd_in_since":1706110751,"num_remapped_pgs":0} 2024-01-24T15:39:33.936 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph osd dump --format=json 2024-01-24T15:39:34.297 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.a/config 2024-01-24T15:39:34.591 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:34 smithi005 ceph-mon[35346]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:34.591 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:34 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/3150381217' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-24T15:39:34.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:34 smithi204 ceph-mon[39634]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:34.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:34 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/3150381217' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-24T15:39:34.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:34 smithi160 ceph-mon[38982]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:34.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:34 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/3150381217' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-24T15:39:35.537 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.535+0000 7f9044600700 1 -- 172.21.15.5:0/2082438250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f903c100fc0 msgr2=0x7f903c1013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:35.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.535+0000 7f9044600700 1 --2- 172.21.15.5:0/2082438250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f903c100fc0 0x7f903c1013a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f902c009990 tx=0x7f902c009ca0 comp rx=0 tx=0).stop 2024-01-24T15:39:35.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.535+0000 7f9044600700 1 -- 172.21.15.5:0/2082438250 shutdown_connections 2024-01-24T15:39:35.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.535+0000 7f9044600700 1 --2- 172.21.15.5:0/2082438250 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f903c1060a0 0x7f903c10dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:35.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.535+0000 7f9044600700 1 --2- 172.21.15.5:0/2082438250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f903c100fc0 0x7f903c1013a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:35.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.535+0000 7f9044600700 1 --2- 172.21.15.5:0/2082438250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f903c101970 0x7f903c1059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:35.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.535+0000 7f9044600700 1 -- 172.21.15.5:0/2082438250 >> 172.21.15.5:0/2082438250 conn(0x7f903c0fc830 msgr2=0x7f903c0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:35.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.536+0000 7f9044600700 1 -- 172.21.15.5:0/2082438250 shutdown_connections 2024-01-24T15:39:35.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.536+0000 7f9044600700 1 -- 172.21.15.5:0/2082438250 wait complete. 2024-01-24T15:39:35.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.537+0000 7f9044600700 1 Processor -- start 2024-01-24T15:39:35.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.537+0000 7f9044600700 1 -- start start 2024-01-24T15:39:35.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.537+0000 7f9044600700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f903c100fc0 0x7f903c199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:35.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.537+0000 7f9044600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f903c101970 0x7f903c1995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:35.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.537+0000 7f9044600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f903c1060a0 0x7f903c19da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:35.540 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.537+0000 7f9044600700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c19e020 con 0x7f903c101970 2024-01-24T15:39:35.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.537+0000 7f9044600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c19e190 con 0x7f903c1060a0 2024-01-24T15:39:35.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.537+0000 7f9044600700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c19e350 con 0x7f903c100fc0 2024-01-24T15:39:35.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.537+0000 7f9041200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f903c101970 0x7f903c1995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:35.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.538+0000 7f9041200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f903c101970 0x7f903c1995a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39360/0 (socket says 172.21.15.5:39360) 2024-01-24T15:39:35.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.538+0000 7f9041200700 1 -- 172.21.15.5:0/615163731 learned_addr learned my addr 172.21.15.5:0/615163731 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:39:35.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.538+0000 7f9042600700 1 --2- 172.21.15.5:0/615163731 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f903c1060a0 0x7f903c19da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:35.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.538+0000 7f9041c00700 1 --2- 172.21.15.5:0/615163731 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f903c100fc0 0x7f903c199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:35.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.538+0000 7f9041200700 1 -- 172.21.15.5:0/615163731 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f903c100fc0 msgr2=0x7f903c199060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:35.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.538+0000 7f9041200700 1 --2- 172.21.15.5:0/615163731 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f903c100fc0 0x7f903c199060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:35.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.538+0000 7f9041200700 1 -- 172.21.15.5:0/615163731 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f903c1060a0 msgr2=0x7f903c19da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:35.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.538+0000 7f9041200700 1 --2- 172.21.15.5:0/615163731 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f903c1060a0 0x7f903c19da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:35.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.538+0000 7f9041200700 1 -- 172.21.15.5:0/615163731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902c0095f0 con 0x7f903c101970 2024-01-24T15:39:35.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.538+0000 7f9041200700 1 --2- 172.21.15.5:0/615163731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f903c101970 0x7f903c1995a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f902400d980 tx=0x7f902400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:35.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.538+0000 7f903a000700 1 -- 172.21.15.5:0/615163731 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902400f890 con 0x7f903c101970 2024-01-24T15:39:35.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.539+0000 7f903a000700 1 -- 172.21.15.5:0/615163731 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f902400fe80 con 0x7f903c101970 2024-01-24T15:39:35.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.539+0000 7f9044600700 1 -- 172.21.15.5:0/615163731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f903c19e630 con 0x7f903c101970 2024-01-24T15:39:35.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.539+0000 7f903a000700 1 -- 172.21.15.5:0/615163731 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902400e3b0 con 0x7f903c101970 2024-01-24T15:39:35.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.539+0000 7f9044600700 1 -- 172.21.15.5:0/615163731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903c1a5e90 con 0x7f903c101970 2024-01-24T15:39:35.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.540+0000 7f9044600700 1 -- 172.21.15.5:0/615163731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903c04ea40 con 0x7f903c101970 2024-01-24T15:39:35.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.542+0000 7f903a000700 1 -- 172.21.15.5:0/615163731 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f902400f9f0 con 0x7f903c101970 2024-01-24T15:39:35.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.543+0000 7f903a000700 1 --2- 172.21.15.5:0/615163731 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f901c0a0520 0x7f901c0a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:35.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.543+0000 7f903a000700 1 -- 172.21.15.5:0/615163731 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f90240cafe0 con 0x7f903c101970 2024-01-24T15:39:35.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.543+0000 7f9041c00700 1 --2- 172.21.15.5:0/615163731 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f901c0a0520 0x7f901c0a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:35.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.544+0000 7f9041c00700 1 --2- 172.21.15.5:0/615163731 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f901c0a0520 0x7f901c0a29e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f902c00b5c0 tx=0x7f902c009f00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:35.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.546+0000 7f903a000700 1 -- 172.21.15.5:0/615163731 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f9024094fa0 con 0x7f903c101970 2024-01-24T15:39:35.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.755+0000 7f9044600700 1 -- 172.21.15.5:0/615163731 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f903c1a60c0 con 0x7f903c101970 2024-01-24T15:39:35.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.756+0000 7f903a000700 1 -- 172.21.15.5:0/615163731 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+18376 (secure 0 0 0) 0x7f90240985c0 con 0x7f903c101970 2024-01-24T15:39:35.758 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:39:35.758 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":78,"fsid":"bede0bb6-bacd-11ee-95b1-87774f69a715","created":"2024-01-24T15:33:13.568798+0000","modified":"2024-01-24T15:39:32.604313+0000","last_up_change":"2024-01-24T15:39:31.302244+0000","last_in_change":"2024-01-24T15:39:11.995261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T15:36:17.760558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"caab3496-5d11-4c8e-bd4f-ca7cdb6924a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3395335330},{"type":"v1","addr":"172.21.15.5:6803","nonce":3395335330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3395335330},{"type":"v1","addr":"172.21.15.5:6805","nonce":3395335330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3395335330},{"type":"v1","addr":"172.21.15.5:6809","nonce":3395335330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3395335330},{"type":"v1","addr":"172.21.15.5:6807","nonce":3395335330}]},"public_addr":"172.21.15.5:6803/3395335330","cluster_addr":"172.21.15.5:6805/3395335330","heartbeat_back_addr":"172.21.15.5:6809/3395335330","heartbeat_front_addr":"172.21.15.5:6807/3395335330","state":["exists","up"]},{"osd":1,"uuid":"547ee262-816e-46ee-b4d4-8dd267abb2de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1386884060},{"type":"v1","addr":"172.21.15.160:6801","nonce":1386884060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1386884060},{"type":"v1","addr":"172.21.15.160:6803","nonce":1386884060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1386884060},{"type":"v1","addr":"172.21.15.160:6807","nonce":1386884060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1386884060},{"type":"v1","addr":"172.21.15.160:6805","nonce":1386884060}]},"public_addr":"172.21.15.160:6801/1386884060","cluster_addr":"172.21.15.160:6803/1386884060","heartbeat_back_addr":"172.21.15.160:6807/1386884060","heartbeat_front_addr":"172.21.15.160:6805/1386884060","state":["exists","up"]},{"osd":2,"uuid":"b07d96ff-9584-4e71-a846-e8b939918708","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1780238382},{"type":"v1","addr":"172.21.15.204:6801","nonce":1780238382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1780238382},{"type":"v1","addr":"172.21.15.204:6803","nonce":1780238382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1780238382},{"type":"v1","addr":"172.21.15.204:6807","nonce":1780238382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1780238382},{"type":"v1","addr":"172.21.15.204:6805","nonce":1780238382}]},"public_addr":"172.21.15.204:6801/1780238382","cluster_addr":"172.21.15.204:6803/1780238382","heartbeat_back_addr":"172.21.15.204:6807/1780238382","heartbeat_front_addr":"172.21.15.204:6805/1780238382","state":["exists","up"]},{"osd":3,"uuid":"4a086309-5d6b-4226-93d0-e3e55ced7172","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2647874051},{"type":"v1","addr":"172.21.15.5:6811","nonce":2647874051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2647874051},{"type":"v1","addr":"172.21.15.5:6813","nonce":2647874051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2647874051},{"type":"v1","addr":"172.21.15.5:6817","nonce":2647874051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2647874051},{"type":"v1","addr":"172.21.15.5:6815","nonce":2647874051}]},"public_addr":"172.21.15.5:6811/2647874051","cluster_addr":"172.21.15.5:6813/2647874051","heartbeat_back_addr":"172.21.15.5:6817/2647874051","heartbeat_front_addr":"172.21.15.5:6815/2647874051","state":["exists","up"]},{"osd":4,"uuid":"27d27d11-ef97-4faf-b5fb-c744bbdbcf9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4260815326},{"type":"v1","addr":"172.21.15.160:6809","nonce":4260815326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4260815326},{"type":"v1","addr":"172.21.15.160:6811","nonce":4260815326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4260815326},{"type":"v1","addr":"172.21.15.160:6815","nonce":4260815326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4260815326},{"type":"v1","addr":"172.21.15.160:6813","nonce":4260815326}]},"public_addr":"172.21.15.160:6809/4260815326","cluster_addr":"172.21.15.160:6811/4260815326","heartbeat_back_addr":"172.21.15.160:6815/4260815326","heartbeat_front_addr":"172.21.15.160:6813/4260815326","state":["exists","up"]},{"osd":5,"uuid":"12425c52-d7ae-46f9-a949-c089587b3ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":1024339043},{"type":"v1","addr":"172.21.15.204:6809","nonce":1024339043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":1024339043},{"type":"v1","addr":"172.21.15.204:6811","nonce":1024339043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":1024339043},{"type":"v1","addr":"172.21.15.204:6815","nonce":1024339043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":1024339043},{"type":"v1","addr":"172.21.15.204:6813","nonce":1024339043}]},"public_addr":"172.21.15.204:6809/1024339043","cluster_addr":"172.21.15.204:6811/1024339043","heartbeat_back_addr":"172.21.15.204:6815/1024339043","heartbeat_front_addr":"172.21.15.204:6813/1024339043","state":["exists","up"]},{"osd":6,"uuid":"2dda7ced-0f36-4f9e-aa2c-3d2d03990ed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":754402627},{"type":"v1","addr":"172.21.15.5:6819","nonce":754402627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":754402627},{"type":"v1","addr":"172.21.15.5:6821","nonce":754402627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":754402627},{"type":"v1","addr":"172.21.15.5:6825","nonce":754402627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":754402627},{"type":"v1","addr":"172.21.15.5:6823","nonce":754402627}]},"public_addr":"172.21.15.5:6819/754402627","cluster_addr":"172.21.15.5:6821/754402627","heartbeat_back_addr":"172.21.15.5:6825/754402627","heartbeat_front_addr":"172.21.15.5:6823/754402627","state":["exists","up"]},{"osd":7,"uuid":"cafcc179-ee88-44b5-a3b0-e8d772bf8ac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":369148145},{"type":"v1","addr":"172.21.15.160:6817","nonce":369148145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":369148145},{"type":"v1","addr":"172.21.15.160:6819","nonce":369148145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":369148145},{"type":"v1","addr":"172.21.15.160:6823","nonce":369148145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":369148145},{"type":"v1","addr":"172.21.15.160:6821","nonce":369148145}]},"public_addr":"172.21.15.160:6817/369148145","cluster_addr":"172.21.15.160:6819/369148145","heartbeat_back_addr":"172.21.15.160:6823/369148145","heartbeat_front_addr":"172.21.15.160:6821/369148145","state":["exists","up"]},{"osd":8,"uuid":"02951778-7bd2-4628-a9e2-4029d1d94fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1351316997},{"type":"v1","addr":"172.21.15.204:6817","nonce":1351316997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":1351316997},{"type":"v1","addr":"172.21.15.204:6819","nonce":1351316997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":1351316997},{"type":"v1","addr":"172.21.15.204:6823","nonce":1351316997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":1351316997},{"type":"v1","addr":"172.21.15.204:6821","nonce":1351316997}]},"public_addr":"172.21.15.204:6817/1351316997","cluster_addr":"172.21.15.204:6819/1351316997","heartbeat_back_addr":"172.21.15.204:6823/1351316997","heartbeat_front_addr":"172.21.15.204:6821/1351316997","state":["exists","up"]},{"osd":9,"uuid":"ae93d215-dc45-4916-a42d-72d7da51260c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2119772860},{"type":"v1","addr":"172.21.15.5:6827","nonce":2119772860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2119772860},{"type":"v1","addr":"172.21.15.5:6829","nonce":2119772860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2119772860},{"type":"v1","addr":"172.21.15.5:6833","nonce":2119772860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2119772860},{"type":"v1","addr":"172.21.15.5:6831","nonce":2119772860}]},"public_addr":"172.21.15.5:6827/2119772860","cluster_addr":"172.21.15.5:6829/2119772860","heartbeat_back_addr":"172.21.15.5:6833/2119772860","heartbeat_front_addr":"172.21.15.5:6831/2119772860","state":["exists","up"]},{"osd":10,"uuid":"6c22bfc5-3d41-491a-b862-18ef48485d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4035458661},{"type":"v1","addr":"172.21.15.160:6825","nonce":4035458661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":4035458661},{"type":"v1","addr":"172.21.15.160:6827","nonce":4035458661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":4035458661},{"type":"v1","addr":"172.21.15.160:6831","nonce":4035458661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":4035458661},{"type":"v1","addr":"172.21.15.160:6829","nonce":4035458661}]},"public_addr":"172.21.15.160:6825/4035458661","cluster_addr":"172.21.15.160:6827/4035458661","heartbeat_back_addr":"172.21.15.160:6831/4035458661","heartbeat_front_addr":"172.21.15.160:6829/4035458661","state":["exists","up"]},{"osd":11,"uuid":"f7b11c08-6aaa-4c9c-bf3e-794e0ed6a48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":1270764757},{"type":"v1","addr":"172.21.15.204:6825","nonce":1270764757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":1270764757},{"type":"v1","addr":"172.21.15.204:6827","nonce":1270764757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":1270764757},{"type":"v1","addr":"172.21.15.204:6831","nonce":1270764757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":1270764757},{"type":"v1","addr":"172.21.15.204:6829","nonce":1270764757}]},"public_addr":"172.21.15.204:6825/1270764757","cluster_addr":"172.21.15.204:6827/1270764757","heartbeat_back_addr":"172.21.15.204:6831/1270764757","heartbeat_front_addr":"172.21.15.204:6829/1270764757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:35:30.487540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:35:51.102011+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:36:13.732852+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:36:35.091981+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:36:55.969859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:37:19.104930+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:37:40.814117+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:38:01.341317+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:38:24.655220+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:38:46.055116+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:39:06.708244+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:39:29.705438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/2286807214":"2024-01-25T15:34:07.143709+0000","172.21.15.5:0/335989886":"2024-01-25T15:34:07.143709+0000","172.21.15.5:0/3245435659":"2024-01-25T15:33:43.447232+0000","172.21.15.5:6800/1174207089":"2024-01-25T15:33:43.447232+0000","172.21.15.5:6800/2286807214":"2024-01-25T15:34:07.143709+0000","172.21.15.5:0/1119155546":"2024-01-25T15:34:07.143709+0000","172.21.15.5:0/1582462061":"2024-01-25T15:33:43.447232+0000","172.21.15.5:0/815108608":"2024-01-25T15:33:43.447232+0000","172.21.15.5:6801/1174207089":"2024-01-25T15:33:43.447232+0000","172.21.15.5:0/3735059725":"2024-01-25T15:34:07.143709+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T15:39:35.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.758+0000 7f9044600700 1 -- 172.21.15.5:0/615163731 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f901c0a0520 msgr2=0x7f901c0a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:35.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.758+0000 7f9044600700 1 --2- 172.21.15.5:0/615163731 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f901c0a0520 0x7f901c0a29e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f902c00b5c0 tx=0x7f902c009f00 comp rx=0 tx=0).stop 2024-01-24T15:39:35.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.758+0000 7f9044600700 1 -- 172.21.15.5:0/615163731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f903c101970 msgr2=0x7f903c1995a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:35.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.758+0000 7f9044600700 1 --2- 172.21.15.5:0/615163731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f903c101970 0x7f903c1995a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f902400d980 tx=0x7f902400dc90 comp rx=0 tx=0).stop 2024-01-24T15:39:35.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.758+0000 7f9044600700 1 -- 172.21.15.5:0/615163731 shutdown_connections 2024-01-24T15:39:35.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.758+0000 7f9044600700 1 --2- 172.21.15.5:0/615163731 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f903c1060a0 0x7f903c19da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:35.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.758+0000 7f9044600700 1 --2- 172.21.15.5:0/615163731 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f903c100fc0 0x7f903c199060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:35.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.758+0000 7f9044600700 1 --2- 172.21.15.5:0/615163731 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f901c0a0520 0x7f901c0a29e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:35.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.758+0000 7f9044600700 1 --2- 172.21.15.5:0/615163731 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f903c101970 0x7f903c1995a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:35.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.758+0000 7f9044600700 1 -- 172.21.15.5:0/615163731 >> 172.21.15.5:0/615163731 conn(0x7f903c0fc830 msgr2=0x7f903c0fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:35.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.758+0000 7f9044600700 1 -- 172.21.15.5:0/615163731 shutdown_connections 2024-01-24T15:39:35.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:35.758+0000 7f9044600700 1 -- 172.21.15.5:0/615163731 wait complete. 2024-01-24T15:39:36.107 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T15:36:17.760558+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T15:39:36.107 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-01-24T15:39:36.432 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:36 smithi005 ceph-mon[35346]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:36.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:36 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/615163731' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-24T15:39:36.467 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.a/config 2024-01-24T15:39:36.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:36 smithi204 ceph-mon[39634]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:36.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:36 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/615163731' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-24T15:39:36.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:36 smithi160 ceph-mon[38982]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:36.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:36 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/615163731' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-24T15:39:37.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.571+0000 7f59ef000700 1 -- 172.21.15.5:0/3654149777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e8101970 msgr2=0x7f59e81059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:37.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.571+0000 7f59ef000700 1 --2- 172.21.15.5:0/3654149777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e8101970 0x7f59e81059c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009990 tx=0x7f59d0009ca0 comp rx=0 tx=0).stop 2024-01-24T15:39:37.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.571+0000 7f59ef000700 1 -- 172.21.15.5:0/3654149777 shutdown_connections 2024-01-24T15:39:37.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.571+0000 7f59ef000700 1 --2- 172.21.15.5:0/3654149777 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59e81060a0 0x7f59e810dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:37.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.571+0000 7f59ef000700 1 --2- 172.21.15.5:0/3654149777 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59e8100fc0 0x7f59e81013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:37.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.571+0000 7f59ef000700 1 --2- 172.21.15.5:0/3654149777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e8101970 0x7f59e81059c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:37.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.571+0000 7f59ef000700 1 -- 172.21.15.5:0/3654149777 >> 172.21.15.5:0/3654149777 conn(0x7f59e80fc830 msgr2=0x7f59e80fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:37.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.571+0000 7f59ef000700 1 -- 172.21.15.5:0/3654149777 shutdown_connections 2024-01-24T15:39:37.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.571+0000 7f59ef000700 1 -- 172.21.15.5:0/3654149777 wait complete. 2024-01-24T15:39:37.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.572+0000 7f59ef000700 1 Processor -- start 2024-01-24T15:39:37.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.572+0000 7f59ef000700 1 -- start start 2024-01-24T15:39:37.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.573+0000 7f59ef000700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59e8100fc0 0x7f59e8198fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:37.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.573+0000 7f59ef000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e8101970 0x7f59e8199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:37.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.573+0000 7f59ef000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59e81060a0 0x7f59e819d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:37.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.573+0000 7f59ef000700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e819df80 con 0x7f59e8101970 2024-01-24T15:39:37.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.573+0000 7f59ef000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e819e0f0 con 0x7f59e81060a0 2024-01-24T15:39:37.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.573+0000 7f59ef000700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e819e2b0 con 0x7f59e8100fc0 2024-01-24T15:39:37.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.573+0000 7f59e7400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e8101970 0x7f59e8199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:37.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.573+0000 7f59e7400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e8101970 0x7f59e8199500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39370/0 (socket says 172.21.15.5:39370) 2024-01-24T15:39:37.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.573+0000 7f59e7400700 1 -- 172.21.15.5:0/665197154 learned_addr learned my addr 172.21.15.5:0/665197154 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:39:37.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.573+0000 7f59e7e00700 1 --2- 172.21.15.5:0/665197154 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59e8100fc0 0x7f59e8198fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:37.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.574+0000 7f59e7400700 1 -- 172.21.15.5:0/665197154 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59e8100fc0 msgr2=0x7f59e8198fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:37.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.574+0000 7f59e7400700 1 --2- 172.21.15.5:0/665197154 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59e8100fc0 0x7f59e8198fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:37.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.574+0000 7f59e7400700 1 -- 172.21.15.5:0/665197154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59e81060a0 msgr2=0x7f59e819d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:37.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.574+0000 7f59e7400700 1 --2- 172.21.15.5:0/665197154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59e81060a0 0x7f59e819d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:37.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.574+0000 7f59e7400700 1 -- 172.21.15.5:0/665197154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d00095f0 con 0x7f59e8101970 2024-01-24T15:39:37.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.574+0000 7f59e7400700 1 --2- 172.21.15.5:0/665197154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e8101970 0x7f59e8199500 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f59d0005720 tx=0x7f59d0009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:37.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.574+0000 7f59e4c00700 1 -- 172.21.15.5:0/665197154 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d001d070 con 0x7f59e8101970 2024-01-24T15:39:37.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.574+0000 7f59ef000700 1 -- 172.21.15.5:0/665197154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e819e530 con 0x7f59e8101970 2024-01-24T15:39:37.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.574+0000 7f59e4c00700 1 -- 172.21.15.5:0/665197154 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f59d0003f80 con 0x7f59e8101970 2024-01-24T15:39:37.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.574+0000 7f59e4c00700 1 -- 172.21.15.5:0/665197154 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d000fb60 con 0x7f59e8101970 2024-01-24T15:39:37.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.574+0000 7f59ef000700 1 -- 172.21.15.5:0/665197154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e81a5df0 con 0x7f59e8101970 2024-01-24T15:39:37.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.575+0000 7f59ef000700 1 -- 172.21.15.5:0/665197154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e804ea40 con 0x7f59e8101970 2024-01-24T15:39:37.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.578+0000 7f59e4c00700 1 -- 172.21.15.5:0/665197154 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f59d0003af0 con 0x7f59e8101970 2024-01-24T15:39:37.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.579+0000 7f59e4c00700 1 --2- 172.21.15.5:0/665197154 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f59c80a0520 0x7f59c80a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:37.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.579+0000 7f59e4c00700 1 -- 172.21.15.5:0/665197154 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f59d00cc5f0 con 0x7f59e8101970 2024-01-24T15:39:37.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.579+0000 7f59e7e00700 1 --2- 172.21.15.5:0/665197154 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f59c80a0520 0x7f59c80a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:37.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.580+0000 7f59e7e00700 1 --2- 172.21.15.5:0/665197154 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f59c80a0520 0x7f59c80a29e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f59d8005950 tx=0x7f59d800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:37.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.583+0000 7f59e4c00700 1 -- 172.21.15.5:0/665197154 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f59d0096620 con 0x7f59e8101970 2024-01-24T15:39:37.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.790+0000 7f59ef000700 1 -- 172.21.15.5:0/665197154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f59e81a6070 con 0x7f59e8101970 2024-01-24T15:39:37.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.791+0000 7f59e4c00700 1 -- 172.21.15.5:0/665197154 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f59d0099c40 con 0x7f59e8101970 2024-01-24T15:39:37.793 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-01-24T15:39:37.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.793+0000 7f59ef000700 1 -- 172.21.15.5:0/665197154 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f59c80a0520 msgr2=0x7f59c80a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:37.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.793+0000 7f59ef000700 1 --2- 172.21.15.5:0/665197154 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f59c80a0520 0x7f59c80a29e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f59d8005950 tx=0x7f59d800b410 comp rx=0 tx=0).stop 2024-01-24T15:39:37.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.793+0000 7f59ef000700 1 -- 172.21.15.5:0/665197154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e8101970 msgr2=0x7f59e8199500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:37.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.793+0000 7f59ef000700 1 --2- 172.21.15.5:0/665197154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e8101970 0x7f59e8199500 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f59d0005720 tx=0x7f59d0009580 comp rx=0 tx=0).stop 2024-01-24T15:39:37.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.793+0000 7f59ef000700 1 -- 172.21.15.5:0/665197154 shutdown_connections 2024-01-24T15:39:37.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.793+0000 7f59ef000700 1 --2- 172.21.15.5:0/665197154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59e81060a0 0x7f59e819d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:37.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.793+0000 7f59ef000700 1 --2- 172.21.15.5:0/665197154 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f59e8100fc0 0x7f59e8198fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:37.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.793+0000 7f59ef000700 1 --2- 172.21.15.5:0/665197154 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f59c80a0520 0x7f59c80a29e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:37.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.793+0000 7f59ef000700 1 --2- 172.21.15.5:0/665197154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f59e8101970 0x7f59e8199500 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:37.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.793+0000 7f59ef000700 1 -- 172.21.15.5:0/665197154 >> 172.21.15.5:0/665197154 conn(0x7f59e80fc830 msgr2=0x7f59e80fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:37.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.793+0000 7f59ef000700 1 -- 172.21.15.5:0/665197154 shutdown_connections 2024-01-24T15:39:37.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:37.794+0000 7f59ef000700 1 -- 172.21.15.5:0/665197154 wait complete. 2024-01-24T15:39:38.175 INFO:tasks.cephadm:Adding mds.a on smithi005 2024-01-24T15:39:38.175 INFO:tasks.cephadm:Adding mds.d on smithi005 2024-01-24T15:39:38.176 INFO:tasks.cephadm:Adding mds.g on smithi005 2024-01-24T15:39:38.176 INFO:tasks.cephadm:Adding mds.j on smithi005 2024-01-24T15:39:38.176 INFO:tasks.cephadm:Adding mds.b on smithi160 2024-01-24T15:39:38.176 INFO:tasks.cephadm:Adding mds.e on smithi160 2024-01-24T15:39:38.176 INFO:tasks.cephadm:Adding mds.h on smithi160 2024-01-24T15:39:38.176 INFO:tasks.cephadm:Adding mds.k on smithi160 2024-01-24T15:39:38.176 INFO:tasks.cephadm:Adding mds.c on smithi204 2024-01-24T15:39:38.176 INFO:tasks.cephadm:Adding mds.f on smithi204 2024-01-24T15:39:38.176 INFO:tasks.cephadm:Adding mds.i on smithi204 2024-01-24T15:39:38.176 INFO:tasks.cephadm:Adding mds.l on smithi204 2024-01-24T15:39:38.176 DEBUG:teuthology.orchestra.run.smithi204:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4e3182a65800aed6d4aa2f6b86da3cfd72188134 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 -- ceph orch apply mds all '12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi160=b;smithi160=e;smithi160=h;smithi160=k;smithi204=c;smithi204=f;smithi204=i;smithi204=l' 2024-01-24T15:39:38.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:38 smithi005 ceph-mon[35346]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:38.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:38 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/665197154' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-24T15:39:38.545 INFO:teuthology.orchestra.run.smithi204.stderr:Inferring config /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/mon.c/config 2024-01-24T15:39:38.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:38 smithi204 ceph-mon[39634]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:38.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:38 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/665197154' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-24T15:39:38.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:38 smithi160 ceph-mon[38982]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:38.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:38 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/665197154' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-24T15:39:40.077 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.074+0000 7f9322600700 1 -- 172.21.15.204:0/1529427452 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f931c10d210 msgr2=0x7f931c10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:40.077 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.074+0000 7f9322600700 1 --2- 172.21.15.204:0/1529427452 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f931c10d210 0x7f931c10f600 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f931400b0a0 tx=0x7f931400b3b0 comp rx=0 tx=0).stop 2024-01-24T15:39:40.077 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.075+0000 7f9322600700 1 -- 172.21.15.204:0/1529427452 shutdown_connections 2024-01-24T15:39:40.077 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.075+0000 7f9322600700 1 --2- 172.21.15.204:0/1529427452 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f931c10d210 0x7f931c10f600 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:40.077 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.075+0000 7f9322600700 1 --2- 172.21.15.204:0/1529427452 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f931c074d70 0x7f931c0731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:40.077 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.075+0000 7f9322600700 1 --2- 172.21.15.204:0/1529427452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f931c0737a0 0x7f931c073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:40.077 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.075+0000 7f9322600700 1 -- 172.21.15.204:0/1529427452 >> 172.21.15.204:0/1529427452 conn(0x7f931c0fc1f0 msgr2=0x7f931c0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:40.077 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.075+0000 7f9322600700 1 -- 172.21.15.204:0/1529427452 shutdown_connections 2024-01-24T15:39:40.077 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.075+0000 7f9322600700 1 -- 172.21.15.204:0/1529427452 wait complete. 2024-01-24T15:39:40.079 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.076+0000 7f9322600700 1 Processor -- start 2024-01-24T15:39:40.079 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.076+0000 7f9322600700 1 -- start start 2024-01-24T15:39:40.079 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.076+0000 7f9322600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f931c0737a0 0x7f931c19cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:40.079 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.076+0000 7f9322600700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f931c074d70 0x7f931c19d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:40.079 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.076+0000 7f9322600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f931c10d210 0x7f931c1a4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:40.079 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.076+0000 7f9322600700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c1a4ad0 con 0x7f931c0737a0 2024-01-24T15:39:40.080 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.076+0000 7f9322600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c1a4c10 con 0x7f931c10d210 2024-01-24T15:39:40.080 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.076+0000 7f9322600700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c1a4da0 con 0x7f931c074d70 2024-01-24T15:39:40.080 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.077+0000 7f931be00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f931c074d70 0x7f931c19d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:40.080 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.077+0000 7f9321200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f931c0737a0 0x7f931c19cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:40.080 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.077+0000 7f931be00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f931c074d70 0x7f931c19d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.204:59378/0 (socket says 172.21.15.204:59378) 2024-01-24T15:39:40.080 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.077+0000 7f931be00700 1 -- 172.21.15.204:0/806536339 learned_addr learned my addr 172.21.15.204:0/806536339 (peer_addr_for_me v2:172.21.15.204:0/0) 2024-01-24T15:39:40.080 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.077+0000 7f9321c00700 1 --2- 172.21.15.204:0/806536339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f931c10d210 0x7f931c1a4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:40.080 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.077+0000 7f931be00700 1 -- 172.21.15.204:0/806536339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f931c10d210 msgr2=0x7f931c1a4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:40.080 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.077+0000 7f931be00700 1 --2- 172.21.15.204:0/806536339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f931c10d210 0x7f931c1a4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:40.080 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.077+0000 7f931be00700 1 -- 172.21.15.204:0/806536339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f931c0737a0 msgr2=0x7f931c19cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:40.080 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.077+0000 7f931be00700 1 --2- 172.21.15.204:0/806536339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f931c0737a0 0x7f931c19cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:40.080 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.077+0000 7f931be00700 1 -- 172.21.15.204:0/806536339 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9314009d00 con 0x7f931c074d70 2024-01-24T15:39:40.080 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.077+0000 7f9321200700 1 --2- 172.21.15.204:0/806536339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f931c0737a0 0x7f931c19cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T15:39:40.081 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.077+0000 7f931be00700 1 --2- 172.21.15.204:0/806536339 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f931c074d70 0x7f931c19d480 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f930400e9a0 tx=0x7f930400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:40.081 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.077+0000 7f9319600700 1 -- 172.21.15.204:0/806536339 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9304009790 con 0x7f931c074d70 2024-01-24T15:39:40.081 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.078+0000 7f9319600700 1 -- 172.21.15.204:0/806536339 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f930400c810 con 0x7f931c074d70 2024-01-24T15:39:40.081 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.078+0000 7f9322600700 1 -- 172.21.15.204:0/806536339 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f931c1a5080 con 0x7f931c074d70 2024-01-24T15:39:40.081 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.078+0000 7f9319600700 1 -- 172.21.15.204:0/806536339 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9304003bd0 con 0x7f931c074d70 2024-01-24T15:39:40.081 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.078+0000 7f9322600700 1 -- 172.21.15.204:0/806536339 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f931c1a5580 con 0x7f931c074d70 2024-01-24T15:39:40.081 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.079+0000 7f9322600700 1 -- 172.21.15.204:0/806536339 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f931c102d60 con 0x7f931c074d70 2024-01-24T15:39:40.082 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.081+0000 7f9319600700 1 -- 172.21.15.204:0/806536339 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f930400c980 con 0x7f931c074d70 2024-01-24T15:39:40.083 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.082+0000 7f9319600700 1 --2- 172.21.15.204:0/806536339 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f92fc0a0520 0x7f92fc0a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:40.083 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.082+0000 7f9319600700 1 -- 172.21.15.204:0/806536339 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9304014070 con 0x7f931c074d70 2024-01-24T15:39:40.084 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.082+0000 7f9321200700 1 --2- 172.21.15.204:0/806536339 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f92fc0a0520 0x7f92fc0a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:40.084 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.083+0000 7f9321200700 1 --2- 172.21.15.204:0/806536339 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f92fc0a0520 0x7f92fc0a29e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f931c075150 tx=0x7f930c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:40.087 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.086+0000 7f9319600700 1 -- 172.21.15.204:0/806536339 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f93040956c0 con 0x7f931c074d70 2024-01-24T15:39:40.296 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.295+0000 7f9322600700 1 -- 172.21.15.204:0/806536339 --> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi160=b;smithi160=e;smithi160=h;smithi160=k;smithi204=c;smithi204=f;smithi204=i;smithi204=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f931c061380 con 0x7f92fc0a0520 2024-01-24T15:39:40.305 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.304+0000 7f9319600700 1 -- 172.21.15.204:0/806536339 <== mgr.14150 v2:172.21.15.5:6800/1971309753 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f931c061380 con 0x7f92fc0a0520 2024-01-24T15:39:40.305 INFO:teuthology.orchestra.run.smithi204.stdout:Scheduled mds.all update... 2024-01-24T15:39:40.308 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.306+0000 7f9322600700 1 -- 172.21.15.204:0/806536339 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f92fc0a0520 msgr2=0x7f92fc0a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:40.308 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.306+0000 7f9322600700 1 --2- 172.21.15.204:0/806536339 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f92fc0a0520 0x7f92fc0a29e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f931c075150 tx=0x7f930c009260 comp rx=0 tx=0).stop 2024-01-24T15:39:40.308 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.306+0000 7f9322600700 1 -- 172.21.15.204:0/806536339 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f931c074d70 msgr2=0x7f931c19d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:40.308 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.306+0000 7f9322600700 1 --2- 172.21.15.204:0/806536339 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f931c074d70 0x7f931c19d480 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f930400e9a0 tx=0x7f930400ecb0 comp rx=0 tx=0).stop 2024-01-24T15:39:40.308 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.306+0000 7f9322600700 1 -- 172.21.15.204:0/806536339 shutdown_connections 2024-01-24T15:39:40.308 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.306+0000 7f9322600700 1 --2- 172.21.15.204:0/806536339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f931c10d210 0x7f931c1a4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:40.308 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.306+0000 7f9322600700 1 --2- 172.21.15.204:0/806536339 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f92fc0a0520 0x7f92fc0a29e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:40.308 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.306+0000 7f9322600700 1 --2- 172.21.15.204:0/806536339 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f931c0737a0 0x7f931c19cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:40.308 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.306+0000 7f9322600700 1 --2- 172.21.15.204:0/806536339 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f931c074d70 0x7f931c19d480 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:40.309 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.306+0000 7f9322600700 1 -- 172.21.15.204:0/806536339 >> 172.21.15.204:0/806536339 conn(0x7f931c0fc1f0 msgr2=0x7f931c0fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:40.309 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.306+0000 7f9322600700 1 -- 172.21.15.204:0/806536339 shutdown_connections 2024-01-24T15:39:40.309 INFO:teuthology.orchestra.run.smithi204.stderr:2024-01-24T15:39:40.306+0000 7f9322600700 1 -- 172.21.15.204:0/806536339 wait complete. 2024-01-24T15:39:40.627 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:40 smithi204 ceph-mon[39634]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:40.627 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:40 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:40.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:40 smithi005 ceph-mon[35346]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:40.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:40 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:40.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:40 smithi160 ceph-mon[38982]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:40.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:40 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:40.926 DEBUG:teuthology.orchestra.run.smithi005:mds.a> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.a.service 2024-01-24T15:39:40.931 DEBUG:teuthology.orchestra.run.smithi005:mds.d> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.d.service 2024-01-24T15:39:40.976 DEBUG:teuthology.orchestra.run.smithi005:mds.g> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.g.service 2024-01-24T15:39:41.007 INFO:journalctl@ceph.mds.a.smithi005.stdout:-- Logs begin at Wed 2024-01-24 15:16:42 UTC. -- 2024-01-24T15:39:41.010 DEBUG:teuthology.orchestra.run.smithi005:mds.j> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.j.service 2024-01-24T15:39:41.045 INFO:journalctl@ceph.mds.d.smithi005.stdout:-- Logs begin at Wed 2024-01-24 15:16:42 UTC. -- 2024-01-24T15:39:41.048 DEBUG:teuthology.orchestra.run.smithi160:mds.b> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.b.service 2024-01-24T15:39:41.054 DEBUG:teuthology.orchestra.run.smithi160:mds.e> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.e.service 2024-01-24T15:39:41.078 INFO:journalctl@ceph.mds.g.smithi005.stdout:-- Logs begin at Wed 2024-01-24 15:16:42 UTC. -- 2024-01-24T15:39:41.099 DEBUG:teuthology.orchestra.run.smithi160:mds.h> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.h.service 2024-01-24T15:39:41.113 INFO:journalctl@ceph.mds.j.smithi005.stdout:-- Logs begin at Wed 2024-01-24 15:16:42 UTC. -- 2024-01-24T15:39:41.128 INFO:journalctl@ceph.mds.b.smithi160.stdout:-- Logs begin at Wed 2024-01-24 15:17:12 UTC. -- 2024-01-24T15:39:41.131 DEBUG:teuthology.orchestra.run.smithi160:mds.k> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.k.service 2024-01-24T15:39:41.168 INFO:journalctl@ceph.mds.e.smithi160.stdout:-- Logs begin at Wed 2024-01-24 15:17:12 UTC. -- 2024-01-24T15:39:41.172 DEBUG:teuthology.orchestra.run.smithi204:mds.c> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.c.service 2024-01-24T15:39:41.176 DEBUG:teuthology.orchestra.run.smithi204:mds.f> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.f.service 2024-01-24T15:39:41.197 INFO:journalctl@ceph.mds.h.smithi160.stdout:-- Logs begin at Wed 2024-01-24 15:17:12 UTC. -- 2024-01-24T15:39:41.221 DEBUG:teuthology.orchestra.run.smithi204:mds.i> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.i.service 2024-01-24T15:39:41.236 INFO:journalctl@ceph.mds.k.smithi160.stdout:-- Logs begin at Wed 2024-01-24 15:17:12 UTC. -- 2024-01-24T15:39:41.251 INFO:journalctl@ceph.mds.c.smithi204.stdout:-- Logs begin at Wed 2024-01-24 15:17:05 UTC. -- 2024-01-24T15:39:41.254 DEBUG:teuthology.orchestra.run.smithi204:mds.l> sudo journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.l.service 2024-01-24T15:39:41.292 INFO:journalctl@ceph.mds.f.smithi204.stdout:-- Logs begin at Wed 2024-01-24 15:17:05 UTC. -- 2024-01-24T15:39:41.295 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-01-24T15:39:41.295 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T15:39:41.320 INFO:journalctl@ceph.mds.i.smithi204.stdout:-- Logs begin at Wed 2024-01-24 15:17:05 UTC. -- 2024-01-24T15:39:41.360 INFO:journalctl@ceph.mds.l.smithi204.stdout:-- Logs begin at Wed 2024-01-24 15:17:05 UTC. -- 2024-01-24T15:39:41.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:41 smithi204 ceph-mon[39634]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi160=b;smithi160=e;smithi160=h;smithi160=k;smithi204=c;smithi204=f;smithi204=i;smithi204=l", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:39:41.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:41 smithi204 ceph-mon[39634]: Saving service mds.all spec with placement smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi160=b;smithi160=e;smithi160=h;smithi160=k;smithi204=c;smithi204=f;smithi204=i;smithi204=l;count:12 2024-01-24T15:39:41.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:41 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:39:41.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:41 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:41.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:41 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:39:41.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:41 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:41.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:41 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:39:41.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:41 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:39:41.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:41 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:41.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:41 smithi204 ceph-mon[39634]: Deploying daemon mds.l on smithi204 2024-01-24T15:39:41.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.499+0000 7f7993e00700 1 -- 172.21.15.5:0/3655790536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f798c101f30 msgr2=0x7f798c102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:41.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.499+0000 7f7993e00700 1 --2- 172.21.15.5:0/3655790536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f798c101f30 0x7f798c102390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f79740099c0 tx=0x7f7974009cd0 comp rx=0 tx=0).stop 2024-01-24T15:39:41.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.499+0000 7f7993e00700 1 -- 172.21.15.5:0/3655790536 shutdown_connections 2024-01-24T15:39:41.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.499+0000 7f7993e00700 1 --2- 172.21.15.5:0/3655790536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f798c1028d0 0x7f798c109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:41.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.499+0000 7f7993e00700 1 --2- 172.21.15.5:0/3655790536 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f798c100d40 0x7f798c101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:41.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.499+0000 7f7993e00700 1 --2- 172.21.15.5:0/3655790536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f798c101f30 0x7f798c102390 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:41.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.499+0000 7f7993e00700 1 -- 172.21.15.5:0/3655790536 >> 172.21.15.5:0/3655790536 conn(0x7f798c0fc270 msgr2=0x7f798c0fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:41.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.499+0000 7f7993e00700 1 -- 172.21.15.5:0/3655790536 shutdown_connections 2024-01-24T15:39:41.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.499+0000 7f7993e00700 1 -- 172.21.15.5:0/3655790536 wait complete. 2024-01-24T15:39:41.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.501+0000 7f7993e00700 1 Processor -- start 2024-01-24T15:39:41.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.501+0000 7f7993e00700 1 -- start start 2024-01-24T15:39:41.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.502+0000 7f7993e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f798c100d40 0x7f798c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:41.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.502+0000 7f7993e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f798c101f30 0x7f798c073130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:41.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.502+0000 7f7993e00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f798c1028d0 0x7f798c073670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:41.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.502+0000 7f7993e00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798c073e10 con 0x7f798c101f30 2024-01-24T15:39:41.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.502+0000 7f7993e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798c073f80 con 0x7f798c100d40 2024-01-24T15:39:41.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.502+0000 7f7993e00700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798c1a09e0 con 0x7f798c1028d0 2024-01-24T15:39:41.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.502+0000 7f7991400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f798c100d40 0x7f798c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:41.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.502+0000 7f7991400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f798c100d40 0x7f798c074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.5:49474/0 (socket says 172.21.15.5:49474) 2024-01-24T15:39:41.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.502+0000 7f7991400700 1 -- 172.21.15.5:0/925060380 learned_addr learned my addr 172.21.15.5:0/925060380 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:39:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.502+0000 7f7990a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f798c101f30 0x7f798c073130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.502+0000 7f7991e00700 1 --2- 172.21.15.5:0/925060380 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f798c1028d0 0x7f798c073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.502+0000 7f7991400700 1 -- 172.21.15.5:0/925060380 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f798c1028d0 msgr2=0x7f798c073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.502+0000 7f7991400700 1 --2- 172.21.15.5:0/925060380 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f798c1028d0 0x7f798c073670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.502+0000 7f7991400700 1 -- 172.21.15.5:0/925060380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f798c101f30 msgr2=0x7f798c073130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.502+0000 7f7991400700 1 --2- 172.21.15.5:0/925060380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f798c101f30 0x7f798c073130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.502+0000 7f7991400700 1 -- 172.21.15.5:0/925060380 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79740095f0 con 0x7f798c100d40 2024-01-24T15:39:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.503+0000 7f7991400700 1 --2- 172.21.15.5:0/925060380 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f798c100d40 0x7f798c074af0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f797c00e970 tx=0x7f797c00ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:41.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.503+0000 7f798a000700 1 -- 172.21.15.5:0/925060380 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c009790 con 0x7f798c100d40 2024-01-24T15:39:41.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.503+0000 7f7993e00700 1 -- 172.21.15.5:0/925060380 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f798c1a0cc0 con 0x7f798c100d40 2024-01-24T15:39:41.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.503+0000 7f798a000700 1 -- 172.21.15.5:0/925060380 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f797c00c7e0 con 0x7f798c100d40 2024-01-24T15:39:41.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.503+0000 7f798a000700 1 -- 172.21.15.5:0/925060380 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c003bd0 con 0x7f798c100d40 2024-01-24T15:39:41.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.503+0000 7f7993e00700 1 -- 172.21.15.5:0/925060380 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f798c1a11d0 con 0x7f798c100d40 2024-01-24T15:39:41.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.504+0000 7f7993e00700 1 -- 172.21.15.5:0/925060380 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f798c10c450 con 0x7f798c100d40 2024-01-24T15:39:41.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:41 smithi160 ceph-mon[38982]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi160=b;smithi160=e;smithi160=h;smithi160=k;smithi204=c;smithi204=f;smithi204=i;smithi204=l", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:39:41.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:41 smithi160 ceph-mon[38982]: Saving service mds.all spec with placement smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi160=b;smithi160=e;smithi160=h;smithi160=k;smithi204=c;smithi204=f;smithi204=i;smithi204=l;count:12 2024-01-24T15:39:41.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:41 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:39:41.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:41 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:41.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:41 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:39:41.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:41 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:41.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:41 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:39:41.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:41 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:39:41.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:41 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:41.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:41 smithi160 ceph-mon[38982]: Deploying daemon mds.l on smithi204 2024-01-24T15:39:41.508 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.506+0000 7f798a000700 1 -- 172.21.15.5:0/925060380 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f797c00c950 con 0x7f798c100d40 2024-01-24T15:39:41.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.507+0000 7f798a000700 1 --2- 172.21.15.5:0/925060380 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f796c0a0570 0x7f796c0a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:41.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.507+0000 7f798a000700 1 -- 172.21.15.5:0/925060380 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f797c014070 con 0x7f798c100d40 2024-01-24T15:39:41.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.507+0000 7f7990a00700 1 --2- 172.21.15.5:0/925060380 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f796c0a0570 0x7f796c0a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:41.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.508+0000 7f7990a00700 1 --2- 172.21.15.5:0/925060380 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f796c0a0570 0x7f796c0a2a30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7974000c00 tx=0x7f7974005a90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:41.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.510+0000 7f798a000700 1 -- 172.21.15.5:0/925060380 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f797c095760 con 0x7f798c100d40 2024-01-24T15:39:41.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:41 smithi005 ceph-mon[35346]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi160=b;smithi160=e;smithi160=h;smithi160=k;smithi204=c;smithi204=f;smithi204=i;smithi204=l", "target": ["mon-mgr", ""]}]: dispatch 2024-01-24T15:39:41.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:41 smithi005 ceph-mon[35346]: Saving service mds.all spec with placement smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi160=b;smithi160=e;smithi160=h;smithi160=k;smithi204=c;smithi204=f;smithi204=i;smithi204=l;count:12 2024-01-24T15:39:41.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:41 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:39:41.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:41 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:41.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:41 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:39:41.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:41 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:41.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:41 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:39:41.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:41 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:39:41.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:41 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:41.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:41 smithi005 ceph-mon[35346]: Deploying daemon mds.l on smithi204 2024-01-24T15:39:41.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.721+0000 7f7993e00700 1 -- 172.21.15.5:0/925060380 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f798c107ce0 con 0x7f798c100d40 2024-01-24T15:39:41.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.722+0000 7f798a000700 1 -- 172.21.15.5:0/925060380 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+18376 (secure 0 0 0) 0x7f797c098d80 con 0x7f798c100d40 2024-01-24T15:39:41.724 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:39:41.724 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":78,"fsid":"bede0bb6-bacd-11ee-95b1-87774f69a715","created":"2024-01-24T15:33:13.568798+0000","modified":"2024-01-24T15:39:32.604313+0000","last_up_change":"2024-01-24T15:39:31.302244+0000","last_in_change":"2024-01-24T15:39:11.995261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T15:36:17.760558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"caab3496-5d11-4c8e-bd4f-ca7cdb6924a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3395335330},{"type":"v1","addr":"172.21.15.5:6803","nonce":3395335330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3395335330},{"type":"v1","addr":"172.21.15.5:6805","nonce":3395335330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3395335330},{"type":"v1","addr":"172.21.15.5:6809","nonce":3395335330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3395335330},{"type":"v1","addr":"172.21.15.5:6807","nonce":3395335330}]},"public_addr":"172.21.15.5:6803/3395335330","cluster_addr":"172.21.15.5:6805/3395335330","heartbeat_back_addr":"172.21.15.5:6809/3395335330","heartbeat_front_addr":"172.21.15.5:6807/3395335330","state":["exists","up"]},{"osd":1,"uuid":"547ee262-816e-46ee-b4d4-8dd267abb2de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1386884060},{"type":"v1","addr":"172.21.15.160:6801","nonce":1386884060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1386884060},{"type":"v1","addr":"172.21.15.160:6803","nonce":1386884060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1386884060},{"type":"v1","addr":"172.21.15.160:6807","nonce":1386884060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1386884060},{"type":"v1","addr":"172.21.15.160:6805","nonce":1386884060}]},"public_addr":"172.21.15.160:6801/1386884060","cluster_addr":"172.21.15.160:6803/1386884060","heartbeat_back_addr":"172.21.15.160:6807/1386884060","heartbeat_front_addr":"172.21.15.160:6805/1386884060","state":["exists","up"]},{"osd":2,"uuid":"b07d96ff-9584-4e71-a846-e8b939918708","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1780238382},{"type":"v1","addr":"172.21.15.204:6801","nonce":1780238382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1780238382},{"type":"v1","addr":"172.21.15.204:6803","nonce":1780238382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1780238382},{"type":"v1","addr":"172.21.15.204:6807","nonce":1780238382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1780238382},{"type":"v1","addr":"172.21.15.204:6805","nonce":1780238382}]},"public_addr":"172.21.15.204:6801/1780238382","cluster_addr":"172.21.15.204:6803/1780238382","heartbeat_back_addr":"172.21.15.204:6807/1780238382","heartbeat_front_addr":"172.21.15.204:6805/1780238382","state":["exists","up"]},{"osd":3,"uuid":"4a086309-5d6b-4226-93d0-e3e55ced7172","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2647874051},{"type":"v1","addr":"172.21.15.5:6811","nonce":2647874051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2647874051},{"type":"v1","addr":"172.21.15.5:6813","nonce":2647874051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2647874051},{"type":"v1","addr":"172.21.15.5:6817","nonce":2647874051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2647874051},{"type":"v1","addr":"172.21.15.5:6815","nonce":2647874051}]},"public_addr":"172.21.15.5:6811/2647874051","cluster_addr":"172.21.15.5:6813/2647874051","heartbeat_back_addr":"172.21.15.5:6817/2647874051","heartbeat_front_addr":"172.21.15.5:6815/2647874051","state":["exists","up"]},{"osd":4,"uuid":"27d27d11-ef97-4faf-b5fb-c744bbdbcf9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4260815326},{"type":"v1","addr":"172.21.15.160:6809","nonce":4260815326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4260815326},{"type":"v1","addr":"172.21.15.160:6811","nonce":4260815326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4260815326},{"type":"v1","addr":"172.21.15.160:6815","nonce":4260815326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4260815326},{"type":"v1","addr":"172.21.15.160:6813","nonce":4260815326}]},"public_addr":"172.21.15.160:6809/4260815326","cluster_addr":"172.21.15.160:6811/4260815326","heartbeat_back_addr":"172.21.15.160:6815/4260815326","heartbeat_front_addr":"172.21.15.160:6813/4260815326","state":["exists","up"]},{"osd":5,"uuid":"12425c52-d7ae-46f9-a949-c089587b3ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":1024339043},{"type":"v1","addr":"172.21.15.204:6809","nonce":1024339043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":1024339043},{"type":"v1","addr":"172.21.15.204:6811","nonce":1024339043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":1024339043},{"type":"v1","addr":"172.21.15.204:6815","nonce":1024339043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":1024339043},{"type":"v1","addr":"172.21.15.204:6813","nonce":1024339043}]},"public_addr":"172.21.15.204:6809/1024339043","cluster_addr":"172.21.15.204:6811/1024339043","heartbeat_back_addr":"172.21.15.204:6815/1024339043","heartbeat_front_addr":"172.21.15.204:6813/1024339043","state":["exists","up"]},{"osd":6,"uuid":"2dda7ced-0f36-4f9e-aa2c-3d2d03990ed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":754402627},{"type":"v1","addr":"172.21.15.5:6819","nonce":754402627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":754402627},{"type":"v1","addr":"172.21.15.5:6821","nonce":754402627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":754402627},{"type":"v1","addr":"172.21.15.5:6825","nonce":754402627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":754402627},{"type":"v1","addr":"172.21.15.5:6823","nonce":754402627}]},"public_addr":"172.21.15.5:6819/754402627","cluster_addr":"172.21.15.5:6821/754402627","heartbeat_back_addr":"172.21.15.5:6825/754402627","heartbeat_front_addr":"172.21.15.5:6823/754402627","state":["exists","up"]},{"osd":7,"uuid":"cafcc179-ee88-44b5-a3b0-e8d772bf8ac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":369148145},{"type":"v1","addr":"172.21.15.160:6817","nonce":369148145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":369148145},{"type":"v1","addr":"172.21.15.160:6819","nonce":369148145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":369148145},{"type":"v1","addr":"172.21.15.160:6823","nonce":369148145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":369148145},{"type":"v1","addr":"172.21.15.160:6821","nonce":369148145}]},"public_addr":"172.21.15.160:6817/369148145","cluster_addr":"172.21.15.160:6819/369148145","heartbeat_back_addr":"172.21.15.160:6823/369148145","heartbeat_front_addr":"172.21.15.160:6821/369148145","state":["exists","up"]},{"osd":8,"uuid":"02951778-7bd2-4628-a9e2-4029d1d94fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1351316997},{"type":"v1","addr":"172.21.15.204:6817","nonce":1351316997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":1351316997},{"type":"v1","addr":"172.21.15.204:6819","nonce":1351316997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":1351316997},{"type":"v1","addr":"172.21.15.204:6823","nonce":1351316997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":1351316997},{"type":"v1","addr":"172.21.15.204:6821","nonce":1351316997}]},"public_addr":"172.21.15.204:6817/1351316997","cluster_addr":"172.21.15.204:6819/1351316997","heartbeat_back_addr":"172.21.15.204:6823/1351316997","heartbeat_front_addr":"172.21.15.204:6821/1351316997","state":["exists","up"]},{"osd":9,"uuid":"ae93d215-dc45-4916-a42d-72d7da51260c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2119772860},{"type":"v1","addr":"172.21.15.5:6827","nonce":2119772860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2119772860},{"type":"v1","addr":"172.21.15.5:6829","nonce":2119772860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2119772860},{"type":"v1","addr":"172.21.15.5:6833","nonce":2119772860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2119772860},{"type":"v1","addr":"172.21.15.5:6831","nonce":2119772860}]},"public_addr":"172.21.15.5:6827/2119772860","cluster_addr":"172.21.15.5:6829/2119772860","heartbeat_back_addr":"172.21.15.5:6833/2119772860","heartbeat_front_addr":"172.21.15.5:6831/2119772860","state":["exists","up"]},{"osd":10,"uuid":"6c22bfc5-3d41-491a-b862-18ef48485d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4035458661},{"type":"v1","addr":"172.21.15.160:6825","nonce":4035458661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":4035458661},{"type":"v1","addr":"172.21.15.160:6827","nonce":4035458661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":4035458661},{"type":"v1","addr":"172.21.15.160:6831","nonce":4035458661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":4035458661},{"type":"v1","addr":"172.21.15.160:6829","nonce":4035458661}]},"public_addr":"172.21.15.160:6825/4035458661","cluster_addr":"172.21.15.160:6827/4035458661","heartbeat_back_addr":"172.21.15.160:6831/4035458661","heartbeat_front_addr":"172.21.15.160:6829/4035458661","state":["exists","up"]},{"osd":11,"uuid":"f7b11c08-6aaa-4c9c-bf3e-794e0ed6a48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":1270764757},{"type":"v1","addr":"172.21.15.204:6825","nonce":1270764757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":1270764757},{"type":"v1","addr":"172.21.15.204:6827","nonce":1270764757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":1270764757},{"type":"v1","addr":"172.21.15.204:6831","nonce":1270764757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":1270764757},{"type":"v1","addr":"172.21.15.204:6829","nonce":1270764757}]},"public_addr":"172.21.15.204:6825/1270764757","cluster_addr":"172.21.15.204:6827/1270764757","heartbeat_back_addr":"172.21.15.204:6831/1270764757","heartbeat_front_addr":"172.21.15.204:6829/1270764757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:35:30.487540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:35:51.102011+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:36:13.732852+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:36:35.091981+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:36:55.969859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:37:19.104930+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:37:40.814117+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:38:01.341317+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:38:24.655220+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:38:46.055116+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:39:06.708244+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:39:29.705438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/2286807214":"2024-01-25T15:34:07.143709+0000","172.21.15.5:0/335989886":"2024-01-25T15:34:07.143709+0000","172.21.15.5:0/3245435659":"2024-01-25T15:33:43.447232+0000","172.21.15.5:6800/1174207089":"2024-01-25T15:33:43.447232+0000","172.21.15.5:6800/2286807214":"2024-01-25T15:34:07.143709+0000","172.21.15.5:0/1119155546":"2024-01-25T15:34:07.143709+0000","172.21.15.5:0/1582462061":"2024-01-25T15:33:43.447232+0000","172.21.15.5:0/815108608":"2024-01-25T15:33:43.447232+0000","172.21.15.5:6801/1174207089":"2024-01-25T15:33:43.447232+0000","172.21.15.5:0/3735059725":"2024-01-25T15:34:07.143709+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T15:39:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.725+0000 7f7993e00700 1 -- 172.21.15.5:0/925060380 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f796c0a0570 msgr2=0x7f796c0a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.725+0000 7f7993e00700 1 --2- 172.21.15.5:0/925060380 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f796c0a0570 0x7f796c0a2a30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7974000c00 tx=0x7f7974005a90 comp rx=0 tx=0).stop 2024-01-24T15:39:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.725+0000 7f7993e00700 1 -- 172.21.15.5:0/925060380 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f798c100d40 msgr2=0x7f798c074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.725+0000 7f7993e00700 1 --2- 172.21.15.5:0/925060380 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f798c100d40 0x7f798c074af0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f797c00e970 tx=0x7f797c00ec80 comp rx=0 tx=0).stop 2024-01-24T15:39:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.725+0000 7f7993e00700 1 -- 172.21.15.5:0/925060380 shutdown_connections 2024-01-24T15:39:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.725+0000 7f7993e00700 1 --2- 172.21.15.5:0/925060380 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f798c1028d0 0x7f798c073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.725+0000 7f7993e00700 1 --2- 172.21.15.5:0/925060380 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f798c100d40 0x7f798c074af0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.725+0000 7f7993e00700 1 --2- 172.21.15.5:0/925060380 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f796c0a0570 0x7f796c0a2a30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.725+0000 7f7993e00700 1 --2- 172.21.15.5:0/925060380 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f798c101f30 0x7f798c073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.725+0000 7f7993e00700 1 -- 172.21.15.5:0/925060380 >> 172.21.15.5:0/925060380 conn(0x7f798c0fc270 msgr2=0x7f798c0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:41.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.725+0000 7f7993e00700 1 -- 172.21.15.5:0/925060380 shutdown_connections 2024-01-24T15:39:41.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.725+0000 7f7993e00700 1 -- 172.21.15.5:0/925060380 wait complete. 2024-01-24T15:39:41.746 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T15:36:17.760558+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T15:39:41.746 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T15:39:41.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.945+0000 7f1fcd800700 1 -- 172.21.15.5:0/1430332777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fc81028c0 msgr2=0x7f1fc8109170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:41.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.945+0000 7f1fcd800700 1 --2- 172.21.15.5:0/1430332777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fc81028c0 0x7f1fc8109170 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1fc000b0d0 tx=0x7f1fc000b3e0 comp rx=0 tx=0).stop 2024-01-24T15:39:41.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.945+0000 7f1fcd800700 1 -- 172.21.15.5:0/1430332777 shutdown_connections 2024-01-24T15:39:41.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.945+0000 7f1fcd800700 1 --2- 172.21.15.5:0/1430332777 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fc81028c0 0x7f1fc8109170 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:41.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.945+0000 7f1fcd800700 1 --2- 172.21.15.5:0/1430332777 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1fc8100d30 0x7f1fc8101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:41.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.945+0000 7f1fcd800700 1 --2- 172.21.15.5:0/1430332777 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1fc8101f20 0x7f1fc8102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:41.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.945+0000 7f1fcd800700 1 -- 172.21.15.5:0/1430332777 >> 172.21.15.5:0/1430332777 conn(0x7f1fc80fc280 msgr2=0x7f1fc80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:41.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.945+0000 7f1fcd800700 1 -- 172.21.15.5:0/1430332777 shutdown_connections 2024-01-24T15:39:41.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.945+0000 7f1fcd800700 1 -- 172.21.15.5:0/1430332777 wait complete. 2024-01-24T15:39:41.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.947+0000 7f1fcd800700 1 Processor -- start 2024-01-24T15:39:41.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.947+0000 7f1fcd800700 1 -- start start 2024-01-24T15:39:41.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.947+0000 7f1fcd800700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1fc8100d30 0x7f1fc8198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:41.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.947+0000 7f1fcd800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1fc8101f20 0x7f1fc81991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:41.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.948+0000 7f1fcd800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fc81028c0 0x7f1fc81a0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:41.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.948+0000 7f1fcd800700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc81a0820 con 0x7f1fc81028c0 2024-01-24T15:39:41.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.948+0000 7f1fcd800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc81a0990 con 0x7f1fc8101f20 2024-01-24T15:39:41.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.948+0000 7f1fcd800700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc81a0b50 con 0x7f1fc8100d30 2024-01-24T15:39:41.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.948+0000 7f1fc7400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fc81028c0 0x7f1fc81a0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:41.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.948+0000 7f1fc6000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1fc8101f20 0x7f1fc81991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:41.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.948+0000 7f1fc7400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fc81028c0 0x7f1fc81a0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59186/0 (socket says 172.21.15.5:59186) 2024-01-24T15:39:41.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.948+0000 7f1fc7400700 1 -- 172.21.15.5:0/23093425 learned_addr learned my addr 172.21.15.5:0/23093425 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:39:41.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.948+0000 7f1fc6a00700 1 --2- 172.21.15.5:0/23093425 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1fc8100d30 0x7f1fc8198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:41.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.948+0000 7f1fc7400700 1 -- 172.21.15.5:0/23093425 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1fc8100d30 msgr2=0x7f1fc8198cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:41.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.948+0000 7f1fc7400700 1 --2- 172.21.15.5:0/23093425 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1fc8100d30 0x7f1fc8198cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:41.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.948+0000 7f1fc7400700 1 -- 172.21.15.5:0/23093425 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1fc8101f20 msgr2=0x7f1fc81991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:41.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.948+0000 7f1fc7400700 1 --2- 172.21.15.5:0/23093425 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1fc8101f20 0x7f1fc81991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:41.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.948+0000 7f1fc7400700 1 -- 172.21.15.5:0/23093425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc0009d00 con 0x7f1fc81028c0 2024-01-24T15:39:41.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.948+0000 7f1fc7400700 1 --2- 172.21.15.5:0/23093425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fc81028c0 0x7f1fc81a0250 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0009440 tx=0x7f1fc0009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:41.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.949+0000 7f1fbf400700 1 -- 172.21.15.5:0/23093425 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc000e040 con 0x7f1fc81028c0 2024-01-24T15:39:41.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.949+0000 7f1fbf400700 1 -- 172.21.15.5:0/23093425 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fc0012d90 con 0x7f1fc81028c0 2024-01-24T15:39:41.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.949+0000 7f1fcd800700 1 -- 172.21.15.5:0/23093425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc81a0dd0 con 0x7f1fc81028c0 2024-01-24T15:39:41.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.949+0000 7f1fbf400700 1 -- 172.21.15.5:0/23093425 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc001de30 con 0x7f1fc81028c0 2024-01-24T15:39:41.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.949+0000 7f1fcd800700 1 -- 172.21.15.5:0/23093425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc81a11f0 con 0x7f1fc81028c0 2024-01-24T15:39:41.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.950+0000 7f1fcd800700 1 -- 172.21.15.5:0/23093425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc8193240 con 0x7f1fc81028c0 2024-01-24T15:39:41.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.952+0000 7f1fbf400700 1 -- 172.21.15.5:0/23093425 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f1fc0012900 con 0x7f1fc81028c0 2024-01-24T15:39:41.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.954+0000 7f1fbf400700 1 --2- 172.21.15.5:0/23093425 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f1fa80a05a0 0x7f1fa80a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:41.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.954+0000 7f1fbf400700 1 -- 172.21.15.5:0/23093425 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1fc00cd360 con 0x7f1fc81028c0 2024-01-24T15:39:41.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.954+0000 7f1fc6a00700 1 --2- 172.21.15.5:0/23093425 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f1fa80a05a0 0x7f1fa80a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:41.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.955+0000 7f1fc6a00700 1 --2- 172.21.15.5:0/23093425 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f1fa80a05a0 0x7f1fa80a2a60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8199b80 tx=0x7f1fb800a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:41.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:41.958+0000 7f1fbf400700 1 -- 172.21.15.5:0/23093425 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f1fc0097390 con 0x7f1fc81028c0 2024-01-24T15:39:42.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.171+0000 7f1fcd800700 1 -- 172.21.15.5:0/23093425 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1fc80619f0 con 0x7f1fc81028c0 2024-01-24T15:39:42.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.171+0000 7f1fbf400700 1 -- 172.21.15.5:0/23093425 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1fc009a9b0 con 0x7f1fc81028c0 2024-01-24T15:39:42.173 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-01-24T15:39:42.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.174+0000 7f1fcd800700 1 -- 172.21.15.5:0/23093425 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f1fa80a05a0 msgr2=0x7f1fa80a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:42.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.174+0000 7f1fcd800700 1 --2- 172.21.15.5:0/23093425 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f1fa80a05a0 0x7f1fa80a2a60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8199b80 tx=0x7f1fb800a380 comp rx=0 tx=0).stop 2024-01-24T15:39:42.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.174+0000 7f1fcd800700 1 -- 172.21.15.5:0/23093425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fc81028c0 msgr2=0x7f1fc81a0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:42.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.174+0000 7f1fcd800700 1 --2- 172.21.15.5:0/23093425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fc81028c0 0x7f1fc81a0250 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0009440 tx=0x7f1fc0009470 comp rx=0 tx=0).stop 2024-01-24T15:39:42.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.174+0000 7f1fcd800700 1 -- 172.21.15.5:0/23093425 shutdown_connections 2024-01-24T15:39:42.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.174+0000 7f1fcd800700 1 --2- 172.21.15.5:0/23093425 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f1fa80a05a0 0x7f1fa80a2a60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:42.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.174+0000 7f1fcd800700 1 --2- 172.21.15.5:0/23093425 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1fc81028c0 0x7f1fc81a0250 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:42.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.174+0000 7f1fcd800700 1 --2- 172.21.15.5:0/23093425 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f1fc8100d30 0x7f1fc8198cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:42.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.174+0000 7f1fcd800700 1 --2- 172.21.15.5:0/23093425 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1fc8101f20 0x7f1fc81991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:42.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.174+0000 7f1fcd800700 1 -- 172.21.15.5:0/23093425 >> 172.21.15.5:0/23093425 conn(0x7f1fc80fc280 msgr2=0x7f1fc8107860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:42.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.174+0000 7f1fcd800700 1 -- 172.21.15.5:0/23093425 shutdown_connections 2024-01-24T15:39:42.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.174+0000 7f1fcd800700 1 -- 172.21.15.5:0/23093425 wait complete. 2024-01-24T15:39:42.195 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T15:39:42.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.392+0000 7f5d77e00700 1 -- 172.21.15.5:0/2597170113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d70108c00 msgr2=0x7f5d7010b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:42.394 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.392+0000 7f5d77e00700 1 --2- 172.21.15.5:0/2597170113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d70108c00 0x7f5d7010b090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800b0a0 tx=0x7f5d6800b3b0 comp rx=0 tx=0).stop 2024-01-24T15:39:42.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.392+0000 7f5d77e00700 1 -- 172.21.15.5:0/2597170113 shutdown_connections 2024-01-24T15:39:42.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.392+0000 7f5d77e00700 1 --2- 172.21.15.5:0/2597170113 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d70108c00 0x7f5d7010b090 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:42.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.392+0000 7f5d77e00700 1 --2- 172.21.15.5:0/2597170113 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5d70074d80 0x7f5d700731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:42.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.392+0000 7f5d77e00700 1 --2- 172.21.15.5:0/2597170113 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d700737a0 0x7f5d70073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:42.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.392+0000 7f5d77e00700 1 -- 172.21.15.5:0/2597170113 >> 172.21.15.5:0/2597170113 conn(0x7f5d700fc270 msgr2=0x7f5d700fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:42.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.393+0000 7f5d77e00700 1 -- 172.21.15.5:0/2597170113 shutdown_connections 2024-01-24T15:39:42.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.393+0000 7f5d77e00700 1 -- 172.21.15.5:0/2597170113 wait complete. 2024-01-24T15:39:42.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.393+0000 7f5d77e00700 1 Processor -- start 2024-01-24T15:39:42.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.394+0000 7f5d77e00700 1 -- start start 2024-01-24T15:39:42.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.394+0000 7f5d77e00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5d700737a0 0x7f5d70198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:42.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.394+0000 7f5d77e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d70074d80 0x7f5d70199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:42.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.394+0000 7f5d77e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d70108c00 0x7f5d701a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:42.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.394+0000 7f5d77e00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d701a0780 con 0x7f5d70074d80 2024-01-24T15:39:42.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.394+0000 7f5d77e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d701a08f0 con 0x7f5d70108c00 2024-01-24T15:39:42.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.394+0000 7f5d77e00700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d701a0ab0 con 0x7f5d700737a0 2024-01-24T15:39:42.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.394+0000 7f5d74a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d70074d80 0x7f5d70199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:42.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.394+0000 7f5d74a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d70074d80 0x7f5d70199180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59204/0 (socket says 172.21.15.5:59204) 2024-01-24T15:39:42.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.394+0000 7f5d74a00700 1 -- 172.21.15.5:0/3114283674 learned_addr learned my addr 172.21.15.5:0/3114283674 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:39:42.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.394+0000 7f5d75e00700 1 --2- 172.21.15.5:0/3114283674 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d70108c00 0x7f5d701a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:42.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.394+0000 7f5d75400700 1 --2- 172.21.15.5:0/3114283674 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5d700737a0 0x7f5d70198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:42.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.395+0000 7f5d74a00700 1 -- 172.21.15.5:0/3114283674 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5d700737a0 msgr2=0x7f5d70198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:42.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.395+0000 7f5d74a00700 1 --2- 172.21.15.5:0/3114283674 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5d700737a0 0x7f5d70198c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:42.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.395+0000 7f5d74a00700 1 -- 172.21.15.5:0/3114283674 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d70108c00 msgr2=0x7f5d701a01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:42.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.395+0000 7f5d74a00700 1 --2- 172.21.15.5:0/3114283674 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d70108c00 0x7f5d701a01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:42.398 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.395+0000 7f5d74a00700 1 -- 172.21.15.5:0/3114283674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d68009d00 con 0x7f5d70074d80 2024-01-24T15:39:42.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.395+0000 7f5d74a00700 1 --2- 172.21.15.5:0/3114283674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d70074d80 0x7f5d70199180 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800d980 tx=0x7f5d5800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:42.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.395+0000 7f5d6e000700 1 -- 172.21.15.5:0/3114283674 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d58004020 con 0x7f5d70074d80 2024-01-24T15:39:42.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.395+0000 7f5d6e000700 1 -- 172.21.15.5:0/3114283674 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5d58009730 con 0x7f5d70074d80 2024-01-24T15:39:42.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.395+0000 7f5d6e000700 1 -- 172.21.15.5:0/3114283674 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d58003a00 con 0x7f5d70074d80 2024-01-24T15:39:42.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.395+0000 7f5d77e00700 1 -- 172.21.15.5:0/3114283674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d701a0d90 con 0x7f5d70074d80 2024-01-24T15:39:42.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.395+0000 7f5d77e00700 1 -- 172.21.15.5:0/3114283674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d701a11e0 con 0x7f5d70074d80 2024-01-24T15:39:42.399 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.396+0000 7f5d77e00700 1 -- 172.21.15.5:0/3114283674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d701072b0 con 0x7f5d70074d80 2024-01-24T15:39:42.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.398+0000 7f5d6e000700 1 -- 172.21.15.5:0/3114283674 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f5d580098a0 con 0x7f5d70074d80 2024-01-24T15:39:42.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.399+0000 7f5d6e000700 1 --2- 172.21.15.5:0/3114283674 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5d500a05f0 0x7f5d500a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:42.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.400+0000 7f5d6e000700 1 -- 172.21.15.5:0/3114283674 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5d580cb1b0 con 0x7f5d70074d80 2024-01-24T15:39:42.401 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.400+0000 7f5d75400700 1 --2- 172.21.15.5:0/3114283674 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5d500a05f0 0x7f5d500a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:42.402 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.400+0000 7f5d75400700 1 --2- 172.21.15.5:0/3114283674 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5d500a05f0 0x7f5d500a2ab0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5d60005950 tx=0x7f5d600058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:42.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.403+0000 7f5d6e000700 1 -- 172.21.15.5:0/3114283674 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f5d58095150 con 0x7f5d70074d80 2024-01-24T15:39:42.602 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:42 smithi204 ceph-mon[39634]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:42.602 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:42 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/925060380' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-24T15:39:42.602 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:42 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/23093425' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-24T15:39:42.603 INFO:journalctl@ceph.mds.l.smithi204.stdout:Jan 24 15:39:42 smithi204 systemd[1]: Starting Ceph mds.l for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:39:42.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.662+0000 7f5d77e00700 1 -- 172.21.15.5:0/3114283674 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d7002cc70 con 0x7f5d70074d80 2024-01-24T15:39:42.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.663+0000 7f5d6e000700 1 -- 172.21.15.5:0/3114283674 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7f5d58098770 con 0x7f5d70074d80 2024-01-24T15:39:42.664 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:39:42.664 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-01-24T15:39:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.665+0000 7f5d77e00700 1 -- 172.21.15.5:0/3114283674 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5d500a05f0 msgr2=0x7f5d500a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.665+0000 7f5d77e00700 1 --2- 172.21.15.5:0/3114283674 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5d500a05f0 0x7f5d500a2ab0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5d60005950 tx=0x7f5d600058e0 comp rx=0 tx=0).stop 2024-01-24T15:39:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.665+0000 7f5d77e00700 1 -- 172.21.15.5:0/3114283674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d70074d80 msgr2=0x7f5d70199180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.665+0000 7f5d77e00700 1 --2- 172.21.15.5:0/3114283674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d70074d80 0x7f5d70199180 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5d5800d980 tx=0x7f5d5800dc90 comp rx=0 tx=0).stop 2024-01-24T15:39:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.665+0000 7f5d77e00700 1 -- 172.21.15.5:0/3114283674 shutdown_connections 2024-01-24T15:39:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.665+0000 7f5d77e00700 1 --2- 172.21.15.5:0/3114283674 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d70108c00 0x7f5d701a01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.665+0000 7f5d77e00700 1 --2- 172.21.15.5:0/3114283674 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5d700737a0 0x7f5d70198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.665+0000 7f5d77e00700 1 --2- 172.21.15.5:0/3114283674 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5d500a05f0 0x7f5d500a2ab0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.665+0000 7f5d77e00700 1 --2- 172.21.15.5:0/3114283674 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5d70074d80 0x7f5d70199180 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:42.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.665+0000 7f5d77e00700 1 -- 172.21.15.5:0/3114283674 >> 172.21.15.5:0/3114283674 conn(0x7f5d700fc270 msgr2=0x7f5d700fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:42.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.665+0000 7f5d77e00700 1 -- 172.21.15.5:0/3114283674 shutdown_connections 2024-01-24T15:39:42.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:42.665+0000 7f5d77e00700 1 -- 172.21.15.5:0/3114283674 wait complete. 2024-01-24T15:39:42.668 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 1 2024-01-24T15:39:42.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:42 smithi005 ceph-mon[35346]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:42.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:42 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/925060380' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-24T15:39:42.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:42 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/23093425' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-24T15:39:42.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:42 smithi160 ceph-mon[38982]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:42.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:42 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/925060380' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-24T15:39:42.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:42 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/23093425' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-24T15:39:43.475 INFO:journalctl@ceph.mds.l.smithi204.stdout:Jan 24 15:39:43 smithi204 ceph-mds[75187]: -- 172.21.15.204:0/2279673452 <== mon.1 v2:172.21.15.204:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561cd8ab11e0 con 0x561cd8a88c00 2024-01-24T15:39:43.475 INFO:journalctl@ceph.mds.l.smithi204.stdout:Jan 24 15:39:43 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-l[75164]: starting mds.l at 2024-01-24T15:39:43.475 INFO:journalctl@ceph.mds.l.smithi204.stdout:Jan 24 15:39:43 smithi204 bash[75148]: 441ede7602a527ac8854e27c18cb235aea5dc1fffebb72a176276ea929612b2b 2024-01-24T15:39:43.476 INFO:journalctl@ceph.mds.l.smithi204.stdout:Jan 24 15:39:43 smithi204 systemd[1]: Started Ceph mds.l for bede0bb6-bacd-11ee-95b1-87774f69a715. 2024-01-24T15:39:43.476 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:43 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/3114283674' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:39:43.476 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:43 smithi204 ceph-mon[39634]: mds.? [v2:172.21.15.204:6832/3525889833,v1:172.21.15.204:6833/3525889833] up:boot 2024-01-24T15:39:43.476 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:43 smithi204 ceph-mon[39634]: fsmap 1 up:standby 2024-01-24T15:39:43.476 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:43 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-01-24T15:39:43.476 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:43 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:43.476 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:43 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:43.476 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:43 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:43.476 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:43 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:39:43.476 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:43 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:39:43.476 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:43 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:43.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:43 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/3114283674' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:39:43.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:43 smithi005 ceph-mon[35346]: mds.? [v2:172.21.15.204:6832/3525889833,v1:172.21.15.204:6833/3525889833] up:boot 2024-01-24T15:39:43.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:43 smithi005 ceph-mon[35346]: fsmap 1 up:standby 2024-01-24T15:39:43.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:43 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-01-24T15:39:43.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:43 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:43.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:43 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:43.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:43 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:43.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:43 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:39:43.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:43 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:39:43.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:43 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:43.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:43 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/3114283674' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:39:43.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:43 smithi160 ceph-mon[38982]: mds.? [v2:172.21.15.204:6832/3525889833,v1:172.21.15.204:6833/3525889833] up:boot 2024-01-24T15:39:43.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:43 smithi160 ceph-mon[38982]: fsmap 1 up:standby 2024-01-24T15:39:43.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:43 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-01-24T15:39:43.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:43 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:43.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:43 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:43.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:43 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:43.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:43 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:39:43.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:43 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:39:43.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:43 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:44.476 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:44 smithi160 ceph-mon[38982]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:44.476 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:44 smithi160 ceph-mon[38982]: Deploying daemon mds.k on smithi160 2024-01-24T15:39:44.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:44 smithi005 ceph-mon[35346]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:44.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:44 smithi005 ceph-mon[35346]: Deploying daemon mds.k on smithi160 2024-01-24T15:39:44.688 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T15:39:44.724 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:44 smithi204 ceph-mon[39634]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:44.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:44 smithi204 ceph-mon[39634]: Deploying daemon mds.k on smithi160 2024-01-24T15:39:44.896 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.895+0000 7f20dfa00700 1 -- 172.21.15.5:0/3839220007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d8101f30 msgr2=0x7f20d8102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:44.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.895+0000 7f20dfa00700 1 --2- 172.21.15.5:0/3839220007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d8101f30 0x7f20d8102390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f20c00099c0 tx=0x7f20c0009cd0 comp rx=0 tx=0).stop 2024-01-24T15:39:44.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.895+0000 7f20dfa00700 1 -- 172.21.15.5:0/3839220007 shutdown_connections 2024-01-24T15:39:44.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.895+0000 7f20dfa00700 1 --2- 172.21.15.5:0/3839220007 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20d81028d0 0x7f20d8109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:44.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.895+0000 7f20dfa00700 1 --2- 172.21.15.5:0/3839220007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20d8100d40 0x7f20d8101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:44.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.895+0000 7f20dfa00700 1 --2- 172.21.15.5:0/3839220007 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d8101f30 0x7f20d8102390 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:44.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.895+0000 7f20dfa00700 1 -- 172.21.15.5:0/3839220007 >> 172.21.15.5:0/3839220007 conn(0x7f20d80fc270 msgr2=0x7f20d80fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:44.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.895+0000 7f20dfa00700 1 -- 172.21.15.5:0/3839220007 shutdown_connections 2024-01-24T15:39:44.897 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.895+0000 7f20dfa00700 1 -- 172.21.15.5:0/3839220007 wait complete. 2024-01-24T15:39:44.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.896+0000 7f20dfa00700 1 Processor -- start 2024-01-24T15:39:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.896+0000 7f20dfa00700 1 -- start start 2024-01-24T15:39:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.896+0000 7f20dfa00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d8100d40 0x7f20d8074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.896+0000 7f20dfa00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20d8101f30 0x7f20d8073130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.896+0000 7f20dfa00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20d81028d0 0x7f20d8073670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.896+0000 7f20dfa00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d8073e10 con 0x7f20d8100d40 2024-01-24T15:39:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.896+0000 7f20dfa00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d8073f80 con 0x7f20d81028d0 2024-01-24T15:39:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.896+0000 7f20dfa00700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d81a09d0 con 0x7f20d8101f30 2024-01-24T15:39:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.897+0000 7f20dd000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d8100d40 0x7f20d8074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.897+0000 7f20dd000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d8100d40 0x7f20d8074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59236/0 (socket says 172.21.15.5:59236) 2024-01-24T15:39:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.897+0000 7f20dd000700 1 -- 172.21.15.5:0/2838995178 learned_addr learned my addr 172.21.15.5:0/2838995178 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:39:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.897+0000 7f20dda00700 1 --2- 172.21.15.5:0/2838995178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20d81028d0 0x7f20d8073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:44.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.897+0000 7f20d7e00700 1 --2- 172.21.15.5:0/2838995178 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20d8101f30 0x7f20d8073130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:44.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.897+0000 7f20dd000700 1 -- 172.21.15.5:0/2838995178 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20d8101f30 msgr2=0x7f20d8073130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:44.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.897+0000 7f20dd000700 1 --2- 172.21.15.5:0/2838995178 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20d8101f30 0x7f20d8073130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:44.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.897+0000 7f20dd000700 1 -- 172.21.15.5:0/2838995178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20d81028d0 msgr2=0x7f20d8073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:44.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.897+0000 7f20dd000700 1 --2- 172.21.15.5:0/2838995178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20d81028d0 0x7f20d8073670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:44.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.897+0000 7f20dd000700 1 -- 172.21.15.5:0/2838995178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c00095f0 con 0x7f20d8100d40 2024-01-24T15:39:44.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.897+0000 7f20dd000700 1 --2- 172.21.15.5:0/2838995178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d8100d40 0x7f20d8074af0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f20c800d980 tx=0x7f20c800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:44.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.897+0000 7f20d5600700 1 -- 172.21.15.5:0/2838995178 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c800f890 con 0x7f20d8100d40 2024-01-24T15:39:44.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.898+0000 7f20d5600700 1 -- 172.21.15.5:0/2838995178 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f20c800fe80 con 0x7f20d8100d40 2024-01-24T15:39:44.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.898+0000 7f20dfa00700 1 -- 172.21.15.5:0/2838995178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d81a0cb0 con 0x7f20d8100d40 2024-01-24T15:39:44.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.898+0000 7f20d5600700 1 -- 172.21.15.5:0/2838995178 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c8019360 con 0x7f20d8100d40 2024-01-24T15:39:44.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.898+0000 7f20dfa00700 1 -- 172.21.15.5:0/2838995178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d81a11c0 con 0x7f20d8100d40 2024-01-24T15:39:44.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.899+0000 7f20dfa00700 1 -- 172.21.15.5:0/2838995178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d810c450 con 0x7f20d8100d40 2024-01-24T15:39:44.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.901+0000 7f20d5600700 1 -- 172.21.15.5:0/2838995178 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f20c800f9f0 con 0x7f20d8100d40 2024-01-24T15:39:44.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.902+0000 7f20d5600700 1 --2- 172.21.15.5:0/2838995178 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f20b80a05f0 0x7f20b80a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:44.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.902+0000 7f20d5600700 1 -- 172.21.15.5:0/2838995178 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f20c80cb7e0 con 0x7f20d8100d40 2024-01-24T15:39:44.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.902+0000 7f20d7e00700 1 --2- 172.21.15.5:0/2838995178 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f20b80a05f0 0x7f20b80a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:44.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.903+0000 7f20d7e00700 1 --2- 172.21.15.5:0/2838995178 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f20b80a05f0 0x7f20b80a2ab0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f20c000b580 tx=0x7f20c0005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:44.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:44.904+0000 7f20d5600700 1 -- 172.21.15.5:0/2838995178 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f20c8095780 con 0x7f20d8100d40 2024-01-24T15:39:45.163 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:45.162+0000 7f20dfa00700 1 -- 172.21.15.5:0/2838995178 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20d8107cb0 con 0x7f20d8100d40 2024-01-24T15:39:45.164 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:45.162+0000 7f20d5600700 1 -- 172.21.15.5:0/2838995178 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1260 (secure 0 0 0) 0x7f20c8016500 con 0x7f20d8100d40 2024-01-24T15:39:45.164 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:39:45.164 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/3525889833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3525889833},{"type":"v1","addr":"172.21.15.204:6833","nonce":3525889833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-01-24T15:39:45.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:45.165+0000 7f20dfa00700 1 -- 172.21.15.5:0/2838995178 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f20b80a05f0 msgr2=0x7f20b80a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:45.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:45.165+0000 7f20dfa00700 1 --2- 172.21.15.5:0/2838995178 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f20b80a05f0 0x7f20b80a2ab0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f20c000b580 tx=0x7f20c0005ea0 comp rx=0 tx=0).stop 2024-01-24T15:39:45.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:45.165+0000 7f20dfa00700 1 -- 172.21.15.5:0/2838995178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d8100d40 msgr2=0x7f20d8074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:45.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:45.165+0000 7f20dfa00700 1 --2- 172.21.15.5:0/2838995178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d8100d40 0x7f20d8074af0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f20c800d980 tx=0x7f20c800dc90 comp rx=0 tx=0).stop 2024-01-24T15:39:45.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:45.165+0000 7f20dfa00700 1 -- 172.21.15.5:0/2838995178 shutdown_connections 2024-01-24T15:39:45.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:45.165+0000 7f20dfa00700 1 --2- 172.21.15.5:0/2838995178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20d81028d0 0x7f20d8073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:45.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:45.165+0000 7f20dfa00700 1 --2- 172.21.15.5:0/2838995178 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f20b80a05f0 0x7f20b80a2ab0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:45.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:45.165+0000 7f20dfa00700 1 --2- 172.21.15.5:0/2838995178 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d8100d40 0x7f20d8074af0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:45.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:45.165+0000 7f20dfa00700 1 --2- 172.21.15.5:0/2838995178 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20d8101f30 0x7f20d8073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:45.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:45.165+0000 7f20dfa00700 1 -- 172.21.15.5:0/2838995178 >> 172.21.15.5:0/2838995178 conn(0x7f20d80fc270 msgr2=0x7f20d80fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:45.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:45.165+0000 7f20dfa00700 1 -- 172.21.15.5:0/2838995178 shutdown_connections 2024-01-24T15:39:45.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:45.165+0000 7f20dfa00700 1 -- 172.21.15.5:0/2838995178 wait complete. 2024-01-24T15:39:45.168 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 2 2024-01-24T15:39:45.360 INFO:journalctl@ceph.mds.k.smithi160.stdout:Jan 24 15:39:45 smithi160 systemd[1]: Starting Ceph mds.k for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:39:45.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:45 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/2838995178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:39:45.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:45 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/2838995178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:39:45.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:45 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/2838995178' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:39:45.757 INFO:journalctl@ceph.mds.k.smithi160.stdout:Jan 24 15:39:45 smithi160 bash[74032]: 5f2cc4a9171ab41cfbc79ba66c508d510e354fe471a9da0d71446321f8e69bce 2024-01-24T15:39:45.757 INFO:journalctl@ceph.mds.k.smithi160.stdout:Jan 24 15:39:45 smithi160 systemd[1]: Started Ceph mds.k for bede0bb6-bacd-11ee-95b1-87774f69a715. 2024-01-24T15:39:45.757 INFO:journalctl@ceph.mds.k.smithi160.stdout:Jan 24 15:39:45 smithi160 ceph-mds[74071]: -- 172.21.15.160:0/964942883 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55637c3131e0 con 0x55637c2ea800 2024-01-24T15:39:45.757 INFO:journalctl@ceph.mds.k.smithi160.stdout:Jan 24 15:39:45 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-k[74048]: starting mds.k at 2024-01-24T15:39:46.542 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:46 smithi005 ceph-mon[35346]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:46.543 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:46 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:46.543 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:46 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:46.543 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:46 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:46.543 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:46 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:39:46.543 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:46 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:39:46.543 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:46 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:46.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:46 smithi204 ceph-mon[39634]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:46.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:46 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:46.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:46 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:46.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:46 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:46.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:46 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:39:46.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:46 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:39:46.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:46 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:46.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:46 smithi160 ceph-mon[38982]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:46.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:46 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:46.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:46 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:46.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:46 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:46.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:46 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:39:46.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:46 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:39:46.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:46 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:47.186 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T15:39:47.372 INFO:journalctl@ceph.mds.j.smithi005.stdout:Jan 24 15:39:47 smithi005 systemd[1]: Starting Ceph mds.j for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:39:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.495+0000 7f74cf200700 1 -- 172.21.15.5:0/1026974486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74c8108c10 msgr2=0x7f74c810b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.495+0000 7f74cf200700 1 --2- 172.21.15.5:0/1026974486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74c8108c10 0x7f74c810b0a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f74c000b0a0 tx=0x7f74c000b3b0 comp rx=0 tx=0).stop 2024-01-24T15:39:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.495+0000 7f74cf200700 1 -- 172.21.15.5:0/1026974486 shutdown_connections 2024-01-24T15:39:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.495+0000 7f74cf200700 1 --2- 172.21.15.5:0/1026974486 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74c8108c10 0x7f74c810b0a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.495+0000 7f74cf200700 1 --2- 172.21.15.5:0/1026974486 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74c8074d80 0x7f74c80731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.495+0000 7f74cf200700 1 --2- 172.21.15.5:0/1026974486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74c80737a0 0x7f74c8073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.495+0000 7f74cf200700 1 -- 172.21.15.5:0/1026974486 >> 172.21.15.5:0/1026974486 conn(0x7f74c80fc280 msgr2=0x7f74c80fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.495+0000 7f74cf200700 1 -- 172.21.15.5:0/1026974486 shutdown_connections 2024-01-24T15:39:47.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.495+0000 7f74cf200700 1 -- 172.21.15.5:0/1026974486 wait complete. 2024-01-24T15:39:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.496+0000 7f74cf200700 1 Processor -- start 2024-01-24T15:39:47.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.496+0000 7f74cf200700 1 -- start start 2024-01-24T15:39:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.497+0000 7f74cf200700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74c80737a0 0x7f74c8198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.497+0000 7f74cf200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74c8074d80 0x7f74c81990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.497+0000 7f74cf200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74c8108c10 0x7f74c81a0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.497+0000 7f74cf200700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c81a0730 con 0x7f74c8074d80 2024-01-24T15:39:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.497+0000 7f74cf200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c81a0870 con 0x7f74c8108c10 2024-01-24T15:39:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.497+0000 7f74cf200700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c81a0a00 con 0x7f74c80737a0 2024-01-24T15:39:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.497+0000 7f74c7400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74c8074d80 0x7f74c81990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.497+0000 7f74cd200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74c8108c10 0x7f74c81a0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.497+0000 7f74cd200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74c8108c10 0x7f74c81a0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.5:39080/0 (socket says 172.21.15.5:39080) 2024-01-24T15:39:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.497+0000 7f74c7400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74c8074d80 0x7f74c81990f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59252/0 (socket says 172.21.15.5:59252) 2024-01-24T15:39:47.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.497+0000 7f74cd200700 1 -- 172.21.15.5:0/3344146273 learned_addr learned my addr 172.21.15.5:0/3344146273 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:39:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.497+0000 7f74c7e00700 1 --2- 172.21.15.5:0/3344146273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74c80737a0 0x7f74c8198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.498+0000 7f74cd200700 1 -- 172.21.15.5:0/3344146273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74c80737a0 msgr2=0x7f74c8198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.498+0000 7f74cd200700 1 --2- 172.21.15.5:0/3344146273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74c80737a0 0x7f74c8198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.498+0000 7f74cd200700 1 -- 172.21.15.5:0/3344146273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74c8074d80 msgr2=0x7f74c81990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.498+0000 7f74cd200700 1 --2- 172.21.15.5:0/3344146273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74c8074d80 0x7f74c81990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.498+0000 7f74cd200700 1 -- 172.21.15.5:0/3344146273 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c0009d00 con 0x7f74c8108c10 2024-01-24T15:39:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.498+0000 7f74c7400700 1 --2- 172.21.15.5:0/3344146273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74c8074d80 0x7f74c81990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T15:39:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.498+0000 7f74c7e00700 1 --2- 172.21.15.5:0/3344146273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74c80737a0 0x7f74c8198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T15:39:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.498+0000 7f74cd200700 1 --2- 172.21.15.5:0/3344146273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74c8108c10 0x7f74c81a0160 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f74c000d010 tx=0x7f74c000bcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.498+0000 7f74c4c00700 1 -- 172.21.15.5:0/3344146273 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c000e040 con 0x7f74c8108c10 2024-01-24T15:39:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.499+0000 7f74cf200700 1 -- 172.21.15.5:0/3344146273 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c81a0c80 con 0x7f74c8108c10 2024-01-24T15:39:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.499+0000 7f74c4c00700 1 -- 172.21.15.5:0/3344146273 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74c0003e10 con 0x7f74c8108c10 2024-01-24T15:39:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.499+0000 7f74c4c00700 1 -- 172.21.15.5:0/3344146273 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c00052a0 con 0x7f74c8108c10 2024-01-24T15:39:47.502 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.499+0000 7f74cf200700 1 -- 172.21.15.5:0/3344146273 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c81a10b0 con 0x7f74c8108c10 2024-01-24T15:39:47.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.500+0000 7f74cf200700 1 -- 172.21.15.5:0/3344146273 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c81072c0 con 0x7f74c8108c10 2024-01-24T15:39:47.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.502+0000 7f74c4c00700 1 -- 172.21.15.5:0/3344146273 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f74c001d9a0 con 0x7f74c8108c10 2024-01-24T15:39:47.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.503+0000 7f74c4c00700 1 --2- 172.21.15.5:0/3344146273 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f74a80a0570 0x7f74a80a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:47.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.503+0000 7f74c4c00700 1 -- 172.21.15.5:0/3344146273 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f74c00ccc10 con 0x7f74c8108c10 2024-01-24T15:39:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.503+0000 7f74c7e00700 1 --2- 172.21.15.5:0/3344146273 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f74a80a0570 0x7f74a80a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:47.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.504+0000 7f74c7e00700 1 --2- 172.21.15.5:0/3344146273 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f74a80a0570 0x7f74a80a2a30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009fd0 tx=0x7f74b8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:47.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:47 smithi160 ceph-mon[38982]: Deploying daemon mds.j on smithi005 2024-01-24T15:39:47.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:47 smithi160 ceph-mon[38982]: mds.? [v2:172.21.15.160:6832/3072071447,v1:172.21.15.160:6833/3072071447] up:boot 2024-01-24T15:39:47.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:47 smithi160 ceph-mon[38982]: fsmap 2 up:standby 2024-01-24T15:39:47.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:47 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-01-24T15:39:47.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.510+0000 7f74c4c00700 1 -- 172.21.15.5:0/3344146273 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f74c0096cd0 con 0x7f74c8108c10 2024-01-24T15:39:47.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:47 smithi005 ceph-mon[35346]: Deploying daemon mds.j on smithi005 2024-01-24T15:39:47.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:47 smithi005 ceph-mon[35346]: mds.? [v2:172.21.15.160:6832/3072071447,v1:172.21.15.160:6833/3072071447] up:boot 2024-01-24T15:39:47.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:47 smithi005 ceph-mon[35346]: fsmap 2 up:standby 2024-01-24T15:39:47.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:47 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-01-24T15:39:47.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:47 smithi204 ceph-mon[39634]: Deploying daemon mds.j on smithi005 2024-01-24T15:39:47.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:47 smithi204 ceph-mon[39634]: mds.? [v2:172.21.15.160:6832/3072071447,v1:172.21.15.160:6833/3072071447] up:boot 2024-01-24T15:39:47.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:47 smithi204 ceph-mon[39634]: fsmap 2 up:standby 2024-01-24T15:39:47.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:47 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-01-24T15:39:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.811+0000 7f74cf200700 1 -- 172.21.15.5:0/3344146273 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74c802cc70 con 0x7f74c8108c10 2024-01-24T15:39:47.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.812+0000 7f74c4c00700 1 -- 172.21.15.5:0/3344146273 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2020 (secure 0 0 0) 0x7f74c009a2f0 con 0x7f74c8108c10 2024-01-24T15:39:47.813 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:39:47.813 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3072071447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3072071447},{"type":"v1","addr":"172.21.15.160:6833","nonce":3072071447}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/3525889833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3525889833},{"type":"v1","addr":"172.21.15.204:6833","nonce":3525889833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-01-24T15:39:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.815+0000 7f74cf200700 1 -- 172.21.15.5:0/3344146273 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f74a80a0570 msgr2=0x7f74a80a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.815+0000 7f74cf200700 1 --2- 172.21.15.5:0/3344146273 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f74a80a0570 0x7f74a80a2a30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009fd0 tx=0x7f74b8009260 comp rx=0 tx=0).stop 2024-01-24T15:39:47.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.815+0000 7f74cf200700 1 -- 172.21.15.5:0/3344146273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74c8108c10 msgr2=0x7f74c81a0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.815+0000 7f74cf200700 1 --2- 172.21.15.5:0/3344146273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74c8108c10 0x7f74c81a0160 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f74c000d010 tx=0x7f74c000bcc0 comp rx=0 tx=0).stop 2024-01-24T15:39:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.815+0000 7f74cf200700 1 -- 172.21.15.5:0/3344146273 shutdown_connections 2024-01-24T15:39:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.815+0000 7f74cf200700 1 --2- 172.21.15.5:0/3344146273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74c8108c10 0x7f74c81a0160 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.815+0000 7f74cf200700 1 --2- 172.21.15.5:0/3344146273 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f74c80737a0 0x7f74c8198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.815+0000 7f74cf200700 1 --2- 172.21.15.5:0/3344146273 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f74a80a0570 0x7f74a80a2a30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.815+0000 7f74cf200700 1 --2- 172.21.15.5:0/3344146273 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f74c8074d80 0x7f74c81990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.815+0000 7f74cf200700 1 -- 172.21.15.5:0/3344146273 >> 172.21.15.5:0/3344146273 conn(0x7f74c80fc280 msgr2=0x7f74c80fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.815+0000 7f74cf200700 1 -- 172.21.15.5:0/3344146273 shutdown_connections 2024-01-24T15:39:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:47.815+0000 7f74cf200700 1 -- 172.21.15.5:0/3344146273 wait complete. 2024-01-24T15:39:47.817 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 3 2024-01-24T15:39:48.183 INFO:journalctl@ceph.mds.j.smithi005.stdout:Jan 24 15:39:47 smithi005 bash[84711]: 6ad76bbe3c0cf916e916b5b66eaff7f4bcc176bcf2a4e0c5ddf59853dbb06ee6 2024-01-24T15:39:48.183 INFO:journalctl@ceph.mds.j.smithi005.stdout:Jan 24 15:39:47 smithi005 systemd[1]: Started Ceph mds.j for bede0bb6-bacd-11ee-95b1-87774f69a715. 2024-01-24T15:39:48.183 INFO:journalctl@ceph.mds.j.smithi005.stdout:Jan 24 15:39:47 smithi005 ceph-mds[84751]: -- 172.21.15.5:0/1543748750 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ee1fa1b1e0 con 0x55ee1f9f2c00 2024-01-24T15:39:48.183 INFO:journalctl@ceph.mds.j.smithi005.stdout:Jan 24 15:39:47 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-j[84726]: starting mds.j at 2024-01-24T15:39:48.631 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:48 smithi005 ceph-mon[35346]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:48.631 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:48 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/3344146273' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:39:48.631 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:48 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:48.631 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:48 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:48.631 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:48 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:48.631 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:48 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:39:48.632 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:48 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:39:48.632 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:48 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:48.646 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:48 smithi160 ceph-mon[38982]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:48.646 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:48 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/3344146273' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:39:48.646 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:48 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:48.646 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:48 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:48.646 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:48 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:48.647 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:48 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:39:48.647 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:48 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:39:48.647 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:48 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:48.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:48 smithi204 ceph-mon[39634]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:48.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:48 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/3344146273' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:39:48.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:48 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:48.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:48 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:48.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:48 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:48.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:48 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:39:48.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:48 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:39:48.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:48 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:49.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:49 smithi005 ceph-mon[35346]: Deploying daemon mds.d on smithi005 2024-01-24T15:39:49.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:49 smithi005 ceph-mon[35346]: mds.? [v2:172.21.15.5:6834/2310427373,v1:172.21.15.5:6835/2310427373] up:boot 2024-01-24T15:39:49.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:49 smithi005 ceph-mon[35346]: fsmap 3 up:standby 2024-01-24T15:39:49.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:49 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-01-24T15:39:49.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:49 smithi160 ceph-mon[38982]: Deploying daemon mds.d on smithi005 2024-01-24T15:39:49.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:49 smithi160 ceph-mon[38982]: mds.? [v2:172.21.15.5:6834/2310427373,v1:172.21.15.5:6835/2310427373] up:boot 2024-01-24T15:39:49.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:49 smithi160 ceph-mon[38982]: fsmap 3 up:standby 2024-01-24T15:39:49.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:49 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-01-24T15:39:49.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:49 smithi204 ceph-mon[39634]: Deploying daemon mds.d on smithi005 2024-01-24T15:39:49.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:49 smithi204 ceph-mon[39634]: mds.? [v2:172.21.15.5:6834/2310427373,v1:172.21.15.5:6835/2310427373] up:boot 2024-01-24T15:39:49.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:49 smithi204 ceph-mon[39634]: fsmap 3 up:standby 2024-01-24T15:39:49.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:49 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-01-24T15:39:49.728 INFO:journalctl@ceph.mds.d.smithi005.stdout:Jan 24 15:39:49 smithi005 systemd[1]: Starting Ceph mds.d for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:39:49.836 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T15:39:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.061+0000 7f7e9c200700 1 -- 172.21.15.5:0/3529440877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e941028d0 msgr2=0x7f7e94109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.061+0000 7f7e9c200700 1 --2- 172.21.15.5:0/3529440877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e941028d0 0x7f7e94109180 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c00b0d0 tx=0x7f7e8c00b3e0 comp rx=0 tx=0).stop 2024-01-24T15:39:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.062+0000 7f7e9c200700 1 -- 172.21.15.5:0/3529440877 shutdown_connections 2024-01-24T15:39:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.062+0000 7f7e9c200700 1 --2- 172.21.15.5:0/3529440877 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e941028d0 0x7f7e94109180 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.062+0000 7f7e9c200700 1 --2- 172.21.15.5:0/3529440877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e94100d40 0x7f7e94101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.062+0000 7f7e9c200700 1 --2- 172.21.15.5:0/3529440877 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e94101f30 0x7f7e94102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.062+0000 7f7e9c200700 1 -- 172.21.15.5:0/3529440877 >> 172.21.15.5:0/3529440877 conn(0x7f7e940fc270 msgr2=0x7f7e940fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.062+0000 7f7e9c200700 1 -- 172.21.15.5:0/3529440877 shutdown_connections 2024-01-24T15:39:50.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.062+0000 7f7e9c200700 1 -- 172.21.15.5:0/3529440877 wait complete. 2024-01-24T15:39:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.063+0000 7f7e9c200700 1 Processor -- start 2024-01-24T15:39:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.063+0000 7f7e9c200700 1 -- start start 2024-01-24T15:39:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.063+0000 7f7e9c200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e94100d40 0x7f7e94074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.063+0000 7f7e9c200700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e94101f30 0x7f7e94073130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.063+0000 7f7e9c200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e941028d0 0x7f7e94073670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.063+0000 7f7e9c200700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e94073e10 con 0x7f7e94100d40 2024-01-24T15:39:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.063+0000 7f7e9c200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e94073f80 con 0x7f7e941028d0 2024-01-24T15:39:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.063+0000 7f7e9c200700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e941a0a60 con 0x7f7e94101f30 2024-01-24T15:39:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.063+0000 7f7e99800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e94100d40 0x7f7e94074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:50.067 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.064+0000 7f7e99800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e94100d40 0x7f7e94074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59276/0 (socket says 172.21.15.5:59276) 2024-01-24T15:39:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.064+0000 7f7e99800700 1 -- 172.21.15.5:0/1502864475 learned_addr learned my addr 172.21.15.5:0/1502864475 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:39:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.064+0000 7f7e9a200700 1 --2- 172.21.15.5:0/1502864475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e941028d0 0x7f7e94073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.064+0000 7f7e98e00700 1 --2- 172.21.15.5:0/1502864475 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e94101f30 0x7f7e94073130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.064+0000 7f7e99800700 1 -- 172.21.15.5:0/1502864475 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e94101f30 msgr2=0x7f7e94073130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.064+0000 7f7e99800700 1 --2- 172.21.15.5:0/1502864475 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e94101f30 0x7f7e94073130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.064+0000 7f7e99800700 1 -- 172.21.15.5:0/1502864475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e941028d0 msgr2=0x7f7e94073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.064+0000 7f7e99800700 1 --2- 172.21.15.5:0/1502864475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e941028d0 0x7f7e94073670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.064+0000 7f7e99800700 1 -- 172.21.15.5:0/1502864475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c009d00 con 0x7f7e94100d40 2024-01-24T15:39:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.064+0000 7f7e9a200700 1 --2- 172.21.15.5:0/1502864475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e941028d0 0x7f7e94073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T15:39:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.064+0000 7f7e99800700 1 --2- 172.21.15.5:0/1502864475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e94100d40 0x7f7e94074af0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400e970 tx=0x7f7e8400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.065+0000 7f7e92000700 1 -- 172.21.15.5:0/1502864475 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e84009790 con 0x7f7e94100d40 2024-01-24T15:39:50.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.065+0000 7f7e92000700 1 -- 172.21.15.5:0/1502864475 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7e8400eec0 con 0x7f7e94100d40 2024-01-24T15:39:50.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.065+0000 7f7e9c200700 1 -- 172.21.15.5:0/1502864475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e941a0d40 con 0x7f7e94100d40 2024-01-24T15:39:50.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.065+0000 7f7e92000700 1 -- 172.21.15.5:0/1502864475 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e84003c10 con 0x7f7e94100d40 2024-01-24T15:39:50.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.065+0000 7f7e9c200700 1 -- 172.21.15.5:0/1502864475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e941a11e0 con 0x7f7e94100d40 2024-01-24T15:39:50.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.066+0000 7f7e9c200700 1 -- 172.21.15.5:0/1502864475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e94108280 con 0x7f7e94100d40 2024-01-24T15:39:50.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.068+0000 7f7e92000700 1 -- 172.21.15.5:0/1502864475 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f7e84004870 con 0x7f7e94100d40 2024-01-24T15:39:50.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.069+0000 7f7e92000700 1 --2- 172.21.15.5:0/1502864475 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f7e740a05f0 0x7f7e740a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:50.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.070+0000 7f7e92000700 1 -- 172.21.15.5:0/1502864475 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7e84014070 con 0x7f7e94100d40 2024-01-24T15:39:50.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.070+0000 7f7e98e00700 1 --2- 172.21.15.5:0/1502864475 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f7e740a05f0 0x7f7e740a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:50.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.070+0000 7f7e98e00700 1 --2- 172.21.15.5:0/1502864475 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f7e740a05f0 0x7f7e740a2ab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c005950 tx=0x7f7e7c0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:50.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.072+0000 7f7e92000700 1 -- 172.21.15.5:0/1502864475 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f7e840958a0 con 0x7f7e94100d40 2024-01-24T15:39:50.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.352+0000 7f7e9c200700 1 -- 172.21.15.5:0/1502864475 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e9402cf20 con 0x7f7e94100d40 2024-01-24T15:39:50.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.353+0000 7f7e92000700 1 -- 172.21.15.5:0/1502864475 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2774 (secure 0 0 0) 0x7f7e84095020 con 0x7f7e94100d40 2024-01-24T15:39:50.354 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:39:50.354 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3072071447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3072071447},{"type":"v1","addr":"172.21.15.160:6833","nonce":3072071447}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/3525889833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3525889833},{"type":"v1","addr":"172.21.15.204:6833","nonce":3525889833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2310427373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2310427373},{"type":"v1","addr":"172.21.15.5:6835","nonce":2310427373}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4}],"filesystems":[]} 2024-01-24T15:39:50.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.355+0000 7f7e9c200700 1 -- 172.21.15.5:0/1502864475 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f7e740a05f0 msgr2=0x7f7e740a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:50.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.355+0000 7f7e9c200700 1 --2- 172.21.15.5:0/1502864475 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f7e740a05f0 0x7f7e740a2ab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c005950 tx=0x7f7e7c0058e0 comp rx=0 tx=0).stop 2024-01-24T15:39:50.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.355+0000 7f7e9c200700 1 -- 172.21.15.5:0/1502864475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e94100d40 msgr2=0x7f7e94074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:50.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.355+0000 7f7e9c200700 1 --2- 172.21.15.5:0/1502864475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e94100d40 0x7f7e94074af0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400e970 tx=0x7f7e8400ec80 comp rx=0 tx=0).stop 2024-01-24T15:39:50.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.355+0000 7f7e9c200700 1 -- 172.21.15.5:0/1502864475 shutdown_connections 2024-01-24T15:39:50.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.355+0000 7f7e9c200700 1 --2- 172.21.15.5:0/1502864475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e941028d0 0x7f7e94073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:50.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.355+0000 7f7e9c200700 1 --2- 172.21.15.5:0/1502864475 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f7e740a05f0 0x7f7e740a2ab0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:50.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.355+0000 7f7e9c200700 1 --2- 172.21.15.5:0/1502864475 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7e94100d40 0x7f7e94074af0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:50.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.355+0000 7f7e9c200700 1 --2- 172.21.15.5:0/1502864475 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f7e94101f30 0x7f7e94073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:50.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.355+0000 7f7e9c200700 1 -- 172.21.15.5:0/1502864475 >> 172.21.15.5:0/1502864475 conn(0x7f7e940fc270 msgr2=0x7f7e941053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.355+0000 7f7e9c200700 1 -- 172.21.15.5:0/1502864475 shutdown_connections 2024-01-24T15:39:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:50.355+0000 7f7e9c200700 1 -- 172.21.15.5:0/1502864475 wait complete. 2024-01-24T15:39:50.358 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 4 2024-01-24T15:39:50.683 INFO:journalctl@ceph.mds.d.smithi005.stdout:Jan 24 15:39:50 smithi005 bash[85078]: 666f413ece54caea7d75c6c378f9c56c00aadac6815223ba0b87b1ad13e38edc 2024-01-24T15:39:50.683 INFO:journalctl@ceph.mds.d.smithi005.stdout:Jan 24 15:39:50 smithi005 systemd[1]: Started Ceph mds.d for bede0bb6-bacd-11ee-95b1-87774f69a715. 2024-01-24T15:39:50.683 INFO:journalctl@ceph.mds.d.smithi005.stdout:Jan 24 15:39:50 smithi005 ceph-mds[85138]: -- 172.21.15.5:0/526894947 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f471ddb1e0 con 0x55f471db2800 2024-01-24T15:39:50.683 INFO:journalctl@ceph.mds.d.smithi005.stdout:Jan 24 15:39:50 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-d[85114]: starting mds.d at 2024-01-24T15:39:50.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:50 smithi005 ceph-mon[35346]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:50.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:50 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:50.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:50 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:50.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:50 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/1502864475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:39:50.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:50 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:50.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:50 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:39:50.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:50 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:39:50.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:50 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:50.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:50 smithi204 ceph-mon[39634]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:50.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:50 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:50.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:50 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:50.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:50 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/1502864475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:39:50.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:50 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:50.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:50 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:39:50.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:50 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:39:50.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:50 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:50.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:50 smithi160 ceph-mon[38982]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:50.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:50 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:50.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:50 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:50.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:50 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/1502864475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:39:50.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:50 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:50.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:50 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:39:50.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:50 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:39:50.758 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:50 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:51.600 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:51 smithi160 ceph-mon[38982]: Deploying daemon mds.e on smithi160 2024-01-24T15:39:51.600 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:51 smithi160 ceph-mon[38982]: mds.? [v2:172.21.15.5:6836/2985908642,v1:172.21.15.5:6837/2985908642] up:boot 2024-01-24T15:39:51.600 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:51 smithi160 ceph-mon[38982]: fsmap 4 up:standby 2024-01-24T15:39:51.600 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:51 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-01-24T15:39:51.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:51 smithi005 ceph-mon[35346]: Deploying daemon mds.e on smithi160 2024-01-24T15:39:51.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:51 smithi005 ceph-mon[35346]: mds.? [v2:172.21.15.5:6836/2985908642,v1:172.21.15.5:6837/2985908642] up:boot 2024-01-24T15:39:51.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:51 smithi005 ceph-mon[35346]: fsmap 4 up:standby 2024-01-24T15:39:51.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:51 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-01-24T15:39:51.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:51 smithi204 ceph-mon[39634]: Deploying daemon mds.e on smithi160 2024-01-24T15:39:51.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:51 smithi204 ceph-mon[39634]: mds.? [v2:172.21.15.5:6836/2985908642,v1:172.21.15.5:6837/2985908642] up:boot 2024-01-24T15:39:51.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:51 smithi204 ceph-mon[39634]: fsmap 4 up:standby 2024-01-24T15:39:51.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:51 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-01-24T15:39:52.377 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T15:39:52.476 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:52 smithi160 ceph-mon[38982]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:52.476 INFO:journalctl@ceph.mds.e.smithi160.stdout:Jan 24 15:39:52 smithi160 systemd[1]: Starting Ceph mds.e for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:39:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.587+0000 7fb99e400700 1 -- 172.21.15.5:0/2714344370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb998100bb0 msgr2=0x7fb998100fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.587+0000 7fb99e400700 1 --2- 172.21.15.5:0/2714344370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb998100bb0 0x7fb998100fd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb9880099c0 tx=0x7fb988009cd0 comp rx=0 tx=0).stop 2024-01-24T15:39:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.587+0000 7fb99e400700 1 -- 172.21.15.5:0/2714344370 shutdown_connections 2024-01-24T15:39:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.587+0000 7fb99e400700 1 --2- 172.21.15.5:0/2714344370 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb998102740 0x7fb998108ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.587+0000 7fb99e400700 1 --2- 172.21.15.5:0/2714344370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb998100bb0 0x7fb998100fd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.587+0000 7fb99e400700 1 --2- 172.21.15.5:0/2714344370 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb998101da0 0x7fb998102200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:52.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.587+0000 7fb99e400700 1 -- 172.21.15.5:0/2714344370 >> 172.21.15.5:0/2714344370 conn(0x7fb9980fc140 msgr2=0x7fb9980fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:52.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.587+0000 7fb99e400700 1 -- 172.21.15.5:0/2714344370 shutdown_connections 2024-01-24T15:39:52.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.587+0000 7fb99e400700 1 -- 172.21.15.5:0/2714344370 wait complete. 2024-01-24T15:39:52.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.588+0000 7fb99e400700 1 Processor -- start 2024-01-24T15:39:52.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.588+0000 7fb99e400700 1 -- start start 2024-01-24T15:39:52.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.589+0000 7fb99e400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb998100bb0 0x7fb9981987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:52.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.589+0000 7fb99e400700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb998101da0 0x7fb998198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:52.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.589+0000 7fb99e400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb998102740 0x7fb99819fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:52.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.589+0000 7fb99e400700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9981a0330 con 0x7fb998102740 2024-01-24T15:39:52.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.589+0000 7fb99e400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9981a0470 con 0x7fb998100bb0 2024-01-24T15:39:52.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.589+0000 7fb99e400700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9981a0600 con 0x7fb998101da0 2024-01-24T15:39:52.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.589+0000 7fb99da00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb998102740 0x7fb99819fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:52.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.589+0000 7fb99da00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb998102740 0x7fb99819fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44166/0 (socket says 172.21.15.5:44166) 2024-01-24T15:39:52.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.589+0000 7fb99da00700 1 -- 172.21.15.5:0/1950011038 learned_addr learned my addr 172.21.15.5:0/1950011038 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:39:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.589+0000 7fb99d000700 1 --2- 172.21.15.5:0/1950011038 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb998100bb0 0x7fb9981987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.589+0000 7fb997e00700 1 --2- 172.21.15.5:0/1950011038 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb998101da0 0x7fb998198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.589+0000 7fb99da00700 1 -- 172.21.15.5:0/1950011038 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb998101da0 msgr2=0x7fb998198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.589+0000 7fb99da00700 1 --2- 172.21.15.5:0/1950011038 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb998101da0 0x7fb998198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.589+0000 7fb99da00700 1 -- 172.21.15.5:0/1950011038 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb998100bb0 msgr2=0x7fb9981987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.589+0000 7fb99da00700 1 --2- 172.21.15.5:0/1950011038 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb998100bb0 0x7fb9981987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.589+0000 7fb99da00700 1 -- 172.21.15.5:0/1950011038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9880095f0 con 0x7fb998102740 2024-01-24T15:39:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.590+0000 7fb99da00700 1 --2- 172.21.15.5:0/1950011038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb998102740 0x7fb99819fd60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb99000ef30 tx=0x7fb99000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.590+0000 7fb995600700 1 -- 172.21.15.5:0/1950011038 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb990018070 con 0x7fb998102740 2024-01-24T15:39:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.590+0000 7fb995600700 1 -- 172.21.15.5:0/1950011038 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb99000f040 con 0x7fb998102740 2024-01-24T15:39:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.590+0000 7fb99e400700 1 -- 172.21.15.5:0/1950011038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9981a0880 con 0x7fb998102740 2024-01-24T15:39:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.590+0000 7fb995600700 1 -- 172.21.15.5:0/1950011038 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99000cc70 con 0x7fb998102740 2024-01-24T15:39:52.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.590+0000 7fb99e400700 1 -- 172.21.15.5:0/1950011038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9981a0d90 con 0x7fb998102740 2024-01-24T15:39:52.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.591+0000 7fb99e400700 1 -- 172.21.15.5:0/1950011038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb99810c270 con 0x7fb998102740 2024-01-24T15:39:52.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.593+0000 7fb995600700 1 -- 172.21.15.5:0/1950011038 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7fb990007500 con 0x7fb998102740 2024-01-24T15:39:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.594+0000 7fb995600700 1 --2- 172.21.15.5:0/1950011038 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fb9780a0610 0x7fb9780a2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.594+0000 7fb995600700 1 -- 172.21.15.5:0/1950011038 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb9900cb0d0 con 0x7fb998102740 2024-01-24T15:39:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.594+0000 7fb99d000700 1 --2- 172.21.15.5:0/1950011038 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fb9780a0610 0x7fb9780a2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.595+0000 7fb99d000700 1 --2- 172.21.15.5:0/1950011038 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fb9780a0610 0x7fb9780a2ad0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb988000c00 tx=0x7fb98800b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:52.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.598+0000 7fb995600700 1 -- 172.21.15.5:0/1950011038 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7fb990095100 con 0x7fb998102740 2024-01-24T15:39:52.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:52 smithi005 ceph-mon[35346]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:52.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:52 smithi204 ceph-mon[39634]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:52.727 INFO:journalctl@ceph.mds.e.smithi160.stdout:Jan 24 15:39:52 smithi160 bash[74444]: 7277f62a484acf43cde9663a935c1599ae7c0444d000ce3535f16d53f74dcfcb 2024-01-24T15:39:52.727 INFO:journalctl@ceph.mds.e.smithi160.stdout:Jan 24 15:39:52 smithi160 systemd[1]: Started Ceph mds.e for bede0bb6-bacd-11ee-95b1-87774f69a715. 2024-01-24T15:39:52.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.858+0000 7fb99e400700 1 -- 172.21.15.5:0/1950011038 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb99810c400 con 0x7fb998102740 2024-01-24T15:39:52.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.858+0000 7fb995600700 1 -- 172.21.15.5:0/1950011038 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3528 (secure 0 0 0) 0x7fb990098720 con 0x7fb998102740 2024-01-24T15:39:52.860 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:39:52.860 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3072071447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3072071447},{"type":"v1","addr":"172.21.15.160:6833","nonce":3072071447}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/3525889833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3525889833},{"type":"v1","addr":"172.21.15.204:6833","nonce":3525889833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2310427373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2310427373},{"type":"v1","addr":"172.21.15.5:6835","nonce":2310427373}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2985908642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2985908642},{"type":"v1","addr":"172.21.15.5:6837","nonce":2985908642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[]} 2024-01-24T15:39:52.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.861+0000 7fb99e400700 1 -- 172.21.15.5:0/1950011038 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fb9780a0610 msgr2=0x7fb9780a2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:52.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.861+0000 7fb99e400700 1 --2- 172.21.15.5:0/1950011038 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fb9780a0610 0x7fb9780a2ad0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb988000c00 tx=0x7fb98800b540 comp rx=0 tx=0).stop 2024-01-24T15:39:52.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.861+0000 7fb99e400700 1 -- 172.21.15.5:0/1950011038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb998102740 msgr2=0x7fb99819fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:52.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.861+0000 7fb99e400700 1 --2- 172.21.15.5:0/1950011038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb998102740 0x7fb99819fd60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb99000ef30 tx=0x7fb99000c3a0 comp rx=0 tx=0).stop 2024-01-24T15:39:52.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.861+0000 7fb99e400700 1 -- 172.21.15.5:0/1950011038 shutdown_connections 2024-01-24T15:39:52.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.861+0000 7fb99e400700 1 --2- 172.21.15.5:0/1950011038 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fb9780a0610 0x7fb9780a2ad0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:52.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.861+0000 7fb99e400700 1 --2- 172.21.15.5:0/1950011038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb998102740 0x7fb99819fd60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:52.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.861+0000 7fb99e400700 1 --2- 172.21.15.5:0/1950011038 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb998100bb0 0x7fb9981987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:52.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.861+0000 7fb99e400700 1 --2- 172.21.15.5:0/1950011038 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb998101da0 0x7fb998198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:52.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.861+0000 7fb99e400700 1 -- 172.21.15.5:0/1950011038 >> 172.21.15.5:0/1950011038 conn(0x7fb9980fc140 msgr2=0x7fb9980fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:52.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.861+0000 7fb99e400700 1 -- 172.21.15.5:0/1950011038 shutdown_connections 2024-01-24T15:39:52.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:52.861+0000 7fb99e400700 1 -- 172.21.15.5:0/1950011038 wait complete. 2024-01-24T15:39:52.864 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 5 2024-01-24T15:39:53.006 INFO:journalctl@ceph.mds.e.smithi160.stdout:Jan 24 15:39:52 smithi160 ceph-mds[74487]: -- 172.21.15.160:0/3652345971 <== mon.2 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561414fc91e0 con 0x561414fa0800 2024-01-24T15:39:53.007 INFO:journalctl@ceph.mds.e.smithi160.stdout:Jan 24 15:39:52 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-e[74464]: starting mds.e at 2024-01-24T15:39:54.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:53 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:54.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:53 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:54.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:53 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:54.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:53 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:39:54.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:53 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:39:54.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:53 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:54.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:53 smithi005 ceph-mon[35346]: Deploying daemon mds.f on smithi204 2024-01-24T15:39:54.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:53 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/1950011038' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:39:54.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:53 smithi005 ceph-mon[35346]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:54.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:53 smithi005 ceph-mon[35346]: mds.? [v2:172.21.15.160:6834/349535608,v1:172.21.15.160:6835/349535608] up:boot 2024-01-24T15:39:54.183 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:53 smithi005 ceph-mon[35346]: fsmap 5 up:standby 2024-01-24T15:39:54.184 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:53 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-01-24T15:39:54.191 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:53 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:54.191 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:53 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:54.191 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:53 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:54.191 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:53 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:39:54.191 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:53 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:39:54.192 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:53 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:54.192 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:53 smithi204 ceph-mon[39634]: Deploying daemon mds.f on smithi204 2024-01-24T15:39:54.192 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:53 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/1950011038' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:39:54.192 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:53 smithi204 ceph-mon[39634]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:54.192 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:53 smithi204 ceph-mon[39634]: mds.? [v2:172.21.15.160:6834/349535608,v1:172.21.15.160:6835/349535608] up:boot 2024-01-24T15:39:54.192 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:53 smithi204 ceph-mon[39634]: fsmap 5 up:standby 2024-01-24T15:39:54.192 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:53 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-01-24T15:39:54.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:54.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:54.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:54.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:39:54.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:39:54.259 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:54.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:53 smithi160 ceph-mon[38982]: Deploying daemon mds.f on smithi204 2024-01-24T15:39:54.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:53 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/1950011038' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:39:54.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:53 smithi160 ceph-mon[38982]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:54.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:53 smithi160 ceph-mon[38982]: mds.? [v2:172.21.15.160:6834/349535608,v1:172.21.15.160:6835/349535608] up:boot 2024-01-24T15:39:54.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:53 smithi160 ceph-mon[38982]: fsmap 5 up:standby 2024-01-24T15:39:54.260 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:53 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-01-24T15:39:54.884 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T15:39:54.974 INFO:journalctl@ceph.mds.f.smithi204.stdout:Jan 24 15:39:54 smithi204 systemd[1]: Starting Ceph mds.f for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:39:55.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.092+0000 7fae67c00700 1 -- 172.21.15.5:0/3736445978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae601028d0 msgr2=0x7fae60109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:55.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.092+0000 7fae67c00700 1 --2- 172.21.15.5:0/3736445978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae601028d0 0x7fae60109180 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fae5800b0d0 tx=0x7fae5800b3e0 comp rx=0 tx=0).stop 2024-01-24T15:39:55.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.092+0000 7fae67c00700 1 -- 172.21.15.5:0/3736445978 shutdown_connections 2024-01-24T15:39:55.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.092+0000 7fae67c00700 1 --2- 172.21.15.5:0/3736445978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae601028d0 0x7fae60109180 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:55.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.092+0000 7fae67c00700 1 --2- 172.21.15.5:0/3736445978 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae60100d40 0x7fae60101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:55.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.092+0000 7fae67c00700 1 --2- 172.21.15.5:0/3736445978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae60101f30 0x7fae60102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:55.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.092+0000 7fae67c00700 1 -- 172.21.15.5:0/3736445978 >> 172.21.15.5:0/3736445978 conn(0x7fae600fc270 msgr2=0x7fae600fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:55.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.092+0000 7fae67c00700 1 -- 172.21.15.5:0/3736445978 shutdown_connections 2024-01-24T15:39:55.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.092+0000 7fae67c00700 1 -- 172.21.15.5:0/3736445978 wait complete. 2024-01-24T15:39:55.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.093+0000 7fae67c00700 1 Processor -- start 2024-01-24T15:39:55.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.093+0000 7fae67c00700 1 -- start start 2024-01-24T15:39:55.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.093+0000 7fae67c00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae60100d40 0x7fae60198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:55.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.093+0000 7fae67c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae60101f30 0x7fae60199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:55.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.094+0000 7fae67c00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae601028d0 0x7fae601a0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:55.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.094+0000 7fae67c00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae601a0750 con 0x7fae601028d0 2024-01-24T15:39:55.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.094+0000 7fae67c00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae601a0890 con 0x7fae60101f30 2024-01-24T15:39:55.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.094+0000 7fae67c00700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae601a0a20 con 0x7fae60100d40 2024-01-24T15:39:55.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.094+0000 7fae65200700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae60100d40 0x7fae60198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:55.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.094+0000 7fae65200700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae60100d40 0x7fae60198bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.204:3300/0 says I am v2:172.21.15.5:41178/0 (socket says 172.21.15.5:41178) 2024-01-24T15:39:55.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.094+0000 7fae65200700 1 -- 172.21.15.5:0/1678878623 learned_addr learned my addr 172.21.15.5:0/1678878623 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:39:55.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.094+0000 7fae5fe00700 1 --2- 172.21.15.5:0/1678878623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae60101f30 0x7fae60199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:55.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.094+0000 7fae65c00700 1 --2- 172.21.15.5:0/1678878623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae601028d0 0x7fae601a0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:55.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.094+0000 7fae65200700 1 -- 172.21.15.5:0/1678878623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae60101f30 msgr2=0x7fae60199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:55.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.094+0000 7fae65200700 1 --2- 172.21.15.5:0/1678878623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae60101f30 0x7fae60199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:55.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.094+0000 7fae65200700 1 -- 172.21.15.5:0/1678878623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae601028d0 msgr2=0x7fae601a0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:55.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.094+0000 7fae65200700 1 --2- 172.21.15.5:0/1678878623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae601028d0 0x7fae601a0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:55.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.094+0000 7fae65200700 1 -- 172.21.15.5:0/1678878623 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae58009d00 con 0x7fae60100d40 2024-01-24T15:39:55.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.094+0000 7fae65c00700 1 --2- 172.21.15.5:0/1678878623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae601028d0 0x7fae601a0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T15:39:55.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.094+0000 7fae65200700 1 --2- 172.21.15.5:0/1678878623 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae60100d40 0x7fae60198bd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fae5000e970 tx=0x7fae5000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:55.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.095+0000 7fae5d600700 1 -- 172.21.15.5:0/1678878623 <== mon.1 v2:172.21.15.204:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae50009790 con 0x7fae60100d40 2024-01-24T15:39:55.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.095+0000 7fae5d600700 1 -- 172.21.15.5:0/1678878623 <== mon.1 v2:172.21.15.204:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae5000c7e0 con 0x7fae60100d40 2024-01-24T15:39:55.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.095+0000 7fae67c00700 1 -- 172.21.15.5:0/1678878623 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae601a0d00 con 0x7fae60100d40 2024-01-24T15:39:55.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.095+0000 7fae5d600700 1 -- 172.21.15.5:0/1678878623 <== mon.1 v2:172.21.15.204:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae50003bd0 con 0x7fae60100d40 2024-01-24T15:39:55.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.095+0000 7fae67c00700 1 -- 172.21.15.5:0/1678878623 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae601a11c0 con 0x7fae60100d40 2024-01-24T15:39:55.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.096+0000 7fae67c00700 1 -- 172.21.15.5:0/1678878623 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6010c410 con 0x7fae60100d40 2024-01-24T15:39:55.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.098+0000 7fae5d600700 1 -- 172.21.15.5:0/1678878623 <== mon.1 v2:172.21.15.204:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7fae5000c950 con 0x7fae60100d40 2024-01-24T15:39:55.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.099+0000 7fae5d600700 1 --2- 172.21.15.5:0/1678878623 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fae400a0570 0x7fae400a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:55.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.099+0000 7fae5d600700 1 -- 172.21.15.5:0/1678878623 <== mon.1 v2:172.21.15.204:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fae50014070 con 0x7fae60100d40 2024-01-24T15:39:55.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.099+0000 7fae5fe00700 1 --2- 172.21.15.5:0/1678878623 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fae400a0570 0x7fae400a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:55.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.100+0000 7fae5fe00700 1 --2- 172.21.15.5:0/1678878623 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fae400a0570 0x7fae400a2a30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fae48009c60 tx=0x7fae48009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:55.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.102+0000 7fae5d600700 1 -- 172.21.15.5:0/1678878623 <== mon.1 v2:172.21.15.204:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7fae50095760 con 0x7fae60100d40 2024-01-24T15:39:55.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.359+0000 7fae67c00700 1 -- 172.21.15.5:0/1678878623 --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae6010c630 con 0x7fae60100d40 2024-01-24T15:39:55.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.360+0000 7fae5d600700 1 -- 172.21.15.5:0/1678878623 <== mon.1 v2:172.21.15.204:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4285 (secure 0 0 0) 0x7fae50098d80 con 0x7fae60100d40 2024-01-24T15:39:55.362 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:39:55.362 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14625,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/349535608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":349535608},{"type":"v1","addr":"172.21.15.160:6835","nonce":349535608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3072071447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3072071447},{"type":"v1","addr":"172.21.15.160:6833","nonce":3072071447}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/3525889833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3525889833},{"type":"v1","addr":"172.21.15.204:6833","nonce":3525889833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2310427373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2310427373},{"type":"v1","addr":"172.21.15.5:6835","nonce":2310427373}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2985908642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2985908642},{"type":"v1","addr":"172.21.15.5:6837","nonce":2985908642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[]} 2024-01-24T15:39:55.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.363+0000 7fae67c00700 1 -- 172.21.15.5:0/1678878623 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fae400a0570 msgr2=0x7fae400a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:55.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.363+0000 7fae67c00700 1 --2- 172.21.15.5:0/1678878623 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fae400a0570 0x7fae400a2a30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fae48009c60 tx=0x7fae48009260 comp rx=0 tx=0).stop 2024-01-24T15:39:55.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.363+0000 7fae67c00700 1 -- 172.21.15.5:0/1678878623 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae60100d40 msgr2=0x7fae60198bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:55.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.363+0000 7fae67c00700 1 --2- 172.21.15.5:0/1678878623 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae60100d40 0x7fae60198bd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fae5000e970 tx=0x7fae5000ec80 comp rx=0 tx=0).stop 2024-01-24T15:39:55.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.363+0000 7fae67c00700 1 -- 172.21.15.5:0/1678878623 shutdown_connections 2024-01-24T15:39:55.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.363+0000 7fae67c00700 1 --2- 172.21.15.5:0/1678878623 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fae400a0570 0x7fae400a2a30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:55.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.363+0000 7fae67c00700 1 --2- 172.21.15.5:0/1678878623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fae601028d0 0x7fae601a0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:55.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.363+0000 7fae67c00700 1 --2- 172.21.15.5:0/1678878623 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fae60100d40 0x7fae60198bd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:55.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.363+0000 7fae67c00700 1 --2- 172.21.15.5:0/1678878623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae60101f30 0x7fae60199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:55.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.363+0000 7fae67c00700 1 -- 172.21.15.5:0/1678878623 >> 172.21.15.5:0/1678878623 conn(0x7fae600fc270 msgr2=0x7fae600fe490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:55.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.363+0000 7fae67c00700 1 -- 172.21.15.5:0/1678878623 shutdown_connections 2024-01-24T15:39:55.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:55.363+0000 7fae67c00700 1 -- 172.21.15.5:0/1678878623 wait complete. 2024-01-24T15:39:55.366 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 6 2024-01-24T15:39:55.725 INFO:journalctl@ceph.mds.f.smithi204.stdout:Jan 24 15:39:55 smithi204 ceph-mds[75528]: -- 172.21.15.204:0/1481727262 <== mon.2 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55847020f1e0 con 0x5584701e6800 2024-01-24T15:39:55.725 INFO:journalctl@ceph.mds.f.smithi204.stdout:Jan 24 15:39:55 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-f[75505]: starting mds.f at 2024-01-24T15:39:55.725 INFO:journalctl@ceph.mds.f.smithi204.stdout:Jan 24 15:39:55 smithi204 bash[75490]: 511b9d1ab96c19fe0fd7e8baff1d9d164533b6029ce40128e07274f1a4673ec3 2024-01-24T15:39:55.725 INFO:journalctl@ceph.mds.f.smithi204.stdout:Jan 24 15:39:55 smithi204 systemd[1]: Started Ceph mds.f for bede0bb6-bacd-11ee-95b1-87774f69a715. 2024-01-24T15:39:56.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:56 smithi005 ceph-mon[35346]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:56.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:56 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/1678878623' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:39:56.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:56 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:56.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:56 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:56.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:56 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:56.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:56 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:39:56.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:56 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:39:56.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:56 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:56.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:56 smithi204 ceph-mon[39634]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:56.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:56 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/1678878623' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:39:56.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:56 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:56.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:56 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:56.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:56 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:56.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:56 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:39:56.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:56 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:39:56.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:56 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:56.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:56 smithi160 ceph-mon[38982]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:56.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:56 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/1678878623' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:39:56.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:56 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:56.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:56 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:56.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:56 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:56.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:56 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:39:56.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:56 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:39:56.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:56 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:57.384 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T15:39:57.390 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:57 smithi204 ceph-mon[39634]: Deploying daemon mds.c on smithi204 2024-01-24T15:39:57.390 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:57 smithi204 ceph-mon[39634]: mds.? [v2:172.21.15.204:6834/1401493351,v1:172.21.15.204:6835/1401493351] up:boot 2024-01-24T15:39:57.390 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:57 smithi204 ceph-mon[39634]: fsmap 6 up:standby 2024-01-24T15:39:57.390 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:57 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-01-24T15:39:57.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.591+0000 7f20da000700 1 -- 172.21.15.5:0/3757324859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d4108c00 msgr2=0x7f20d410b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:57.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.591+0000 7f20da000700 1 --2- 172.21.15.5:0/3757324859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d4108c00 0x7f20d410b090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f20cc00b0a0 tx=0x7f20cc00b3b0 comp rx=0 tx=0).stop 2024-01-24T15:39:57.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.591+0000 7f20da000700 1 -- 172.21.15.5:0/3757324859 shutdown_connections 2024-01-24T15:39:57.593 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.591+0000 7f20da000700 1 --2- 172.21.15.5:0/3757324859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d4108c00 0x7f20d410b090 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:57.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.591+0000 7f20da000700 1 --2- 172.21.15.5:0/3757324859 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20d4074d80 0x7f20d40731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:57.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.591+0000 7f20da000700 1 --2- 172.21.15.5:0/3757324859 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20d40737a0 0x7f20d4073c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:57.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.591+0000 7f20da000700 1 -- 172.21.15.5:0/3757324859 >> 172.21.15.5:0/3757324859 conn(0x7f20d40fc270 msgr2=0x7f20d40fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:57.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.591+0000 7f20da000700 1 -- 172.21.15.5:0/3757324859 shutdown_connections 2024-01-24T15:39:57.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.591+0000 7f20da000700 1 -- 172.21.15.5:0/3757324859 wait complete. 2024-01-24T15:39:57.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.592+0000 7f20da000700 1 Processor -- start 2024-01-24T15:39:57.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.593+0000 7f20da000700 1 -- start start 2024-01-24T15:39:57.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.593+0000 7f20da000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d40737a0 0x7f20d4198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:57.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.593+0000 7f20da000700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20d4074d80 0x7f20d4199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:57.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.593+0000 7f20da000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20d4108c00 0x7f20d41a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:57.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.593+0000 7f20da000700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d41a0770 con 0x7f20d40737a0 2024-01-24T15:39:57.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.593+0000 7f20da000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d41a08b0 con 0x7f20d4108c00 2024-01-24T15:39:57.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.593+0000 7f20da000700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d41a0a40 con 0x7f20d4074d80 2024-01-24T15:39:57.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.593+0000 7f20d3400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d40737a0 0x7f20d4198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:57.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.593+0000 7f20d3400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d40737a0 0x7f20d4198bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44202/0 (socket says 172.21.15.5:44202) 2024-01-24T15:39:57.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.593+0000 7f20d2a00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20d4074d80 0x7f20d4199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:57.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.593+0000 7f20d3400700 1 -- 172.21.15.5:0/3406805945 learned_addr learned my addr 172.21.15.5:0/3406805945 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:39:57.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.593+0000 7f20d3e00700 1 --2- 172.21.15.5:0/3406805945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20d4108c00 0x7f20d41a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:57.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.593+0000 7f20d3400700 1 -- 172.21.15.5:0/3406805945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20d4074d80 msgr2=0x7f20d4199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:57.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.593+0000 7f20d3400700 1 --2- 172.21.15.5:0/3406805945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20d4074d80 0x7f20d4199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:57.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.593+0000 7f20d3400700 1 -- 172.21.15.5:0/3406805945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20d4108c00 msgr2=0x7f20d41a01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:57.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.593+0000 7f20d3400700 1 --2- 172.21.15.5:0/3406805945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20d4108c00 0x7f20d41a01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:57.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.593+0000 7f20d3400700 1 -- 172.21.15.5:0/3406805945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc009d00 con 0x7f20d40737a0 2024-01-24T15:39:57.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.593+0000 7f20d2a00700 1 --2- 172.21.15.5:0/3406805945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20d4074d80 0x7f20d4199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T15:39:57.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.594+0000 7f20d3400700 1 --2- 172.21.15.5:0/3406805945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d40737a0 0x7f20d4198bf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f20c400e9a0 tx=0x7f20c400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:57.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.594+0000 7f20cbe00700 1 -- 172.21.15.5:0/3406805945 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c4009790 con 0x7f20d40737a0 2024-01-24T15:39:57.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.594+0000 7f20cbe00700 1 -- 172.21.15.5:0/3406805945 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f20c4010430 con 0x7f20d40737a0 2024-01-24T15:39:57.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.594+0000 7f20cbe00700 1 -- 172.21.15.5:0/3406805945 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c400cea0 con 0x7f20d40737a0 2024-01-24T15:39:57.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.594+0000 7f20da000700 1 -- 172.21.15.5:0/3406805945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d41a0d20 con 0x7f20d40737a0 2024-01-24T15:39:57.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.594+0000 7f20da000700 1 -- 172.21.15.5:0/3406805945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d41a1180 con 0x7f20d40737a0 2024-01-24T15:39:57.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.595+0000 7f20da000700 1 -- 172.21.15.5:0/3406805945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d41072b0 con 0x7f20d40737a0 2024-01-24T15:39:57.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.597+0000 7f20cbe00700 1 -- 172.21.15.5:0/3406805945 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f20c40105a0 con 0x7f20d40737a0 2024-01-24T15:39:57.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.598+0000 7f20cbe00700 1 --2- 172.21.15.5:0/3406805945 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f20b40a0570 0x7f20b40a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:39:57.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.598+0000 7f20cbe00700 1 -- 172.21.15.5:0/3406805945 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f20c4014070 con 0x7f20d40737a0 2024-01-24T15:39:57.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.598+0000 7f20d2a00700 1 --2- 172.21.15.5:0/3406805945 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f20b40a0570 0x7f20b40a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:39:57.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.599+0000 7f20d2a00700 1 --2- 172.21.15.5:0/3406805945 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f20b40a0570 0x7f20b40a2a30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f20d4074aa0 tx=0x7f20bc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:39:57.604 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.602+0000 7f20cbe00700 1 -- 172.21.15.5:0/3406805945 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f20c4052120 con 0x7f20d40737a0 2024-01-24T15:39:57.643 INFO:journalctl@ceph.mds.c.smithi204.stdout:Jan 24 15:39:57 smithi204 systemd[1]: Starting Ceph mds.c for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:39:57.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:57 smithi005 ceph-mon[35346]: Deploying daemon mds.c on smithi204 2024-01-24T15:39:57.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:57 smithi005 ceph-mon[35346]: mds.? [v2:172.21.15.204:6834/1401493351,v1:172.21.15.204:6835/1401493351] up:boot 2024-01-24T15:39:57.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:57 smithi005 ceph-mon[35346]: fsmap 6 up:standby 2024-01-24T15:39:57.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:57 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-01-24T15:39:57.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:57 smithi160 ceph-mon[38982]: Deploying daemon mds.c on smithi204 2024-01-24T15:39:57.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:57 smithi160 ceph-mon[38982]: mds.? [v2:172.21.15.204:6834/1401493351,v1:172.21.15.204:6835/1401493351] up:boot 2024-01-24T15:39:57.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:57 smithi160 ceph-mon[38982]: fsmap 6 up:standby 2024-01-24T15:39:57.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:57 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-01-24T15:39:57.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.859+0000 7f20da000700 1 -- 172.21.15.5:0/3406805945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20d402d090 con 0x7f20d40737a0 2024-01-24T15:39:57.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.860+0000 7f20cbe00700 1 -- 172.21.15.5:0/3406805945 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5045 (secure 0 0 0) 0x7f20c40956c0 con 0x7f20d40737a0 2024-01-24T15:39:57.861 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:39:57.862 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14625,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/349535608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":349535608},{"type":"v1","addr":"172.21.15.160:6835","nonce":349535608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3072071447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3072071447},{"type":"v1","addr":"172.21.15.160:6833","nonce":3072071447}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/3525889833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3525889833},{"type":"v1","addr":"172.21.15.204:6833","nonce":3525889833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2310427373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2310427373},{"type":"v1","addr":"172.21.15.5:6835","nonce":2310427373}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2985908642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2985908642},{"type":"v1","addr":"172.21.15.5:6837","nonce":2985908642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24515,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/1401493351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1401493351},{"type":"v1","addr":"172.21.15.204:6835","nonce":1401493351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[]} 2024-01-24T15:39:57.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.862+0000 7f20da000700 1 -- 172.21.15.5:0/3406805945 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f20b40a0570 msgr2=0x7f20b40a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:57.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.862+0000 7f20da000700 1 --2- 172.21.15.5:0/3406805945 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f20b40a0570 0x7f20b40a2a30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f20d4074aa0 tx=0x7f20bc009260 comp rx=0 tx=0).stop 2024-01-24T15:39:57.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.862+0000 7f20da000700 1 -- 172.21.15.5:0/3406805945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d40737a0 msgr2=0x7f20d4198bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:39:57.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.862+0000 7f20da000700 1 --2- 172.21.15.5:0/3406805945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d40737a0 0x7f20d4198bf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f20c400e9a0 tx=0x7f20c400ecb0 comp rx=0 tx=0).stop 2024-01-24T15:39:57.864 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.862+0000 7f20da000700 1 -- 172.21.15.5:0/3406805945 shutdown_connections 2024-01-24T15:39:57.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.862+0000 7f20da000700 1 --2- 172.21.15.5:0/3406805945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20d4108c00 0x7f20d41a01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:57.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.862+0000 7f20da000700 1 --2- 172.21.15.5:0/3406805945 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f20b40a0570 0x7f20b40a2a30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:57.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.862+0000 7f20da000700 1 --2- 172.21.15.5:0/3406805945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f20d40737a0 0x7f20d4198bf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:57.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.862+0000 7f20da000700 1 --2- 172.21.15.5:0/3406805945 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f20d4074d80 0x7f20d4199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:39:57.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.862+0000 7f20da000700 1 -- 172.21.15.5:0/3406805945 >> 172.21.15.5:0/3406805945 conn(0x7f20d40fc270 msgr2=0x7f20d40fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:39:57.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.863+0000 7f20da000700 1 -- 172.21.15.5:0/3406805945 shutdown_connections 2024-01-24T15:39:57.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:39:57.863+0000 7f20da000700 1 -- 172.21.15.5:0/3406805945 wait complete. 2024-01-24T15:39:57.865 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 7 2024-01-24T15:39:58.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:58 smithi204 ceph-mon[39634]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:58.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:58 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/3406805945' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:39:58.475 INFO:journalctl@ceph.mds.c.smithi204.stdout:Jan 24 15:39:58 smithi204 ceph-mds[75871]: -- 172.21.15.204:0/3054065486 <== mon.2 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ba351e91e0 con 0x55ba351c0800 2024-01-24T15:39:58.475 INFO:journalctl@ceph.mds.c.smithi204.stdout:Jan 24 15:39:58 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-c[75848]: starting mds.c at 2024-01-24T15:39:58.475 INFO:journalctl@ceph.mds.c.smithi204.stdout:Jan 24 15:39:58 smithi204 bash[75833]: f5a15fc015f462b1ce0c0199fe4b393e4b92472d7ee32f8748af1b67494e34c9 2024-01-24T15:39:58.475 INFO:journalctl@ceph.mds.c.smithi204.stdout:Jan 24 15:39:58 smithi204 systemd[1]: Started Ceph mds.c for bede0bb6-bacd-11ee-95b1-87774f69a715. 2024-01-24T15:39:58.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:58 smithi005 ceph-mon[35346]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:58.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:58 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/3406805945' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:39:58.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:58 smithi160 ceph-mon[38982]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:39:58.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:58 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/3406805945' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:39:59.557 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:59 smithi160 ceph-mon[38982]: mds.? [v2:172.21.15.204:6836/2142560585,v1:172.21.15.204:6837/2142560585] up:boot 2024-01-24T15:39:59.557 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:59 smithi160 ceph-mon[38982]: fsmap 7 up:standby 2024-01-24T15:39:59.557 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:59 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-01-24T15:39:59.557 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:59 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:59.557 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:59 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:59.557 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:59 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:59.557 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:59 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:39:59.557 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:59 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:39:59.557 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:59 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:59.557 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:39:59 smithi160 ceph-mon[38982]: Deploying daemon mds.h on smithi160 2024-01-24T15:39:59.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:59 smithi005 ceph-mon[35346]: mds.? [v2:172.21.15.204:6836/2142560585,v1:172.21.15.204:6837/2142560585] up:boot 2024-01-24T15:39:59.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:59 smithi005 ceph-mon[35346]: fsmap 7 up:standby 2024-01-24T15:39:59.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:59 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-01-24T15:39:59.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:59 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:59.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:59 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:59.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:59 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:59.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:59 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:39:59.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:59 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:39:59.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:59 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:59.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:39:59 smithi005 ceph-mon[35346]: Deploying daemon mds.h on smithi160 2024-01-24T15:39:59.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:59 smithi204 ceph-mon[39634]: mds.? [v2:172.21.15.204:6836/2142560585,v1:172.21.15.204:6837/2142560585] up:boot 2024-01-24T15:39:59.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:59 smithi204 ceph-mon[39634]: fsmap 7 up:standby 2024-01-24T15:39:59.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:59 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-01-24T15:39:59.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:59 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:59.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:59 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:59.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:59 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:39:59.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:59 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:39:59.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:59 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:39:59.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:59 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:39:59.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:39:59 smithi204 ceph-mon[39634]: Deploying daemon mds.h on smithi160 2024-01-24T15:39:59.884 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T15:40:00.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.092+0000 7fab84200700 1 -- 172.21.15.5:0/2975170587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c1028d0 msgr2=0x7fab7c109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:00.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.092+0000 7fab84200700 1 --2- 172.21.15.5:0/2975170587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c1028d0 0x7fab7c109180 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fab7400b0d0 tx=0x7fab7400b3e0 comp rx=0 tx=0).stop 2024-01-24T15:40:00.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.092+0000 7fab84200700 1 -- 172.21.15.5:0/2975170587 shutdown_connections 2024-01-24T15:40:00.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.092+0000 7fab84200700 1 --2- 172.21.15.5:0/2975170587 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c1028d0 0x7fab7c109180 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:00.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.092+0000 7fab84200700 1 --2- 172.21.15.5:0/2975170587 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab7c100d40 0x7fab7c101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:00.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.092+0000 7fab84200700 1 --2- 172.21.15.5:0/2975170587 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab7c101f30 0x7fab7c102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:00.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.092+0000 7fab84200700 1 -- 172.21.15.5:0/2975170587 >> 172.21.15.5:0/2975170587 conn(0x7fab7c0fc270 msgr2=0x7fab7c0fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:00.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.092+0000 7fab84200700 1 -- 172.21.15.5:0/2975170587 shutdown_connections 2024-01-24T15:40:00.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.092+0000 7fab84200700 1 -- 172.21.15.5:0/2975170587 wait complete. 2024-01-24T15:40:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.093+0000 7fab84200700 1 Processor -- start 2024-01-24T15:40:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.093+0000 7fab84200700 1 -- start start 2024-01-24T15:40:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.094+0000 7fab84200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c100d40 0x7fab7c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.094+0000 7fab84200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab7c101f30 0x7fab7c073130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.094+0000 7fab84200700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab7c1028d0 0x7fab7c073670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.094+0000 7fab84200700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c073e10 con 0x7fab7c100d40 2024-01-24T15:40:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.094+0000 7fab84200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c073f80 con 0x7fab7c101f30 2024-01-24T15:40:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.094+0000 7fab84200700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c1a0a60 con 0x7fab7c1028d0 2024-01-24T15:40:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.094+0000 7fab81800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c100d40 0x7fab7c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.094+0000 7fab81800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c100d40 0x7fab7c074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44224/0 (socket says 172.21.15.5:44224) 2024-01-24T15:40:00.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.094+0000 7fab81800700 1 -- 172.21.15.5:0/3096003996 learned_addr learned my addr 172.21.15.5:0/3096003996 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:40:00.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.094+0000 7fab80e00700 1 --2- 172.21.15.5:0/3096003996 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab7c101f30 0x7fab7c073130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:00.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.094+0000 7fab82200700 1 --2- 172.21.15.5:0/3096003996 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab7c1028d0 0x7fab7c073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:00.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.094+0000 7fab81800700 1 -- 172.21.15.5:0/3096003996 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab7c1028d0 msgr2=0x7fab7c073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:00.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.094+0000 7fab81800700 1 --2- 172.21.15.5:0/3096003996 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab7c1028d0 0x7fab7c073670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:00.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.094+0000 7fab81800700 1 -- 172.21.15.5:0/3096003996 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab7c101f30 msgr2=0x7fab7c073130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:00.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.094+0000 7fab81800700 1 --2- 172.21.15.5:0/3096003996 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab7c101f30 0x7fab7c073130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:00.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.094+0000 7fab81800700 1 -- 172.21.15.5:0/3096003996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab74009d00 con 0x7fab7c100d40 2024-01-24T15:40:00.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.094+0000 7fab81800700 1 --2- 172.21.15.5:0/3096003996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c100d40 0x7fab7c074af0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00e970 tx=0x7fab6c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:00.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.095+0000 7fab7a000700 1 -- 172.21.15.5:0/3096003996 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c009790 con 0x7fab7c100d40 2024-01-24T15:40:00.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.095+0000 7fab7a000700 1 -- 172.21.15.5:0/3096003996 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab6c00eec0 con 0x7fab7c100d40 2024-01-24T15:40:00.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.095+0000 7fab84200700 1 -- 172.21.15.5:0/3096003996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7c1a0d40 con 0x7fab7c100d40 2024-01-24T15:40:00.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.095+0000 7fab7a000700 1 -- 172.21.15.5:0/3096003996 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c003c10 con 0x7fab7c100d40 2024-01-24T15:40:00.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.095+0000 7fab84200700 1 -- 172.21.15.5:0/3096003996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7c1a11a0 con 0x7fab7c100d40 2024-01-24T15:40:00.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.096+0000 7fab84200700 1 -- 172.21.15.5:0/3096003996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab7c108280 con 0x7fab7c100d40 2024-01-24T15:40:00.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.098+0000 7fab7a000700 1 -- 172.21.15.5:0/3096003996 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7fab6c003e50 con 0x7fab7c100d40 2024-01-24T15:40:00.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.099+0000 7fab7a000700 1 --2- 172.21.15.5:0/3096003996 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fab5c0a0570 0x7fab5c0a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:00.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.099+0000 7fab7a000700 1 -- 172.21.15.5:0/3096003996 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fab6c014070 con 0x7fab7c100d40 2024-01-24T15:40:00.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.099+0000 7fab80e00700 1 --2- 172.21.15.5:0/3096003996 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fab5c0a0570 0x7fab5c0a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:00.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.100+0000 7fab80e00700 1 --2- 172.21.15.5:0/3096003996 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fab5c0a0570 0x7fab5c0a2a30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fab64005950 tx=0x7fab6400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:00.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.103+0000 7fab7a000700 1 -- 172.21.15.5:0/3096003996 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7fab6c095770 con 0x7fab7c100d40 2024-01-24T15:40:00.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.366+0000 7fab84200700 1 -- 172.21.15.5:0/3096003996 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab7c02cc70 con 0x7fab7c100d40 2024-01-24T15:40:00.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.367+0000 7fab7a000700 1 -- 172.21.15.5:0/3096003996 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5805 (secure 0 0 0) 0x7fab6c098d90 con 0x7fab7c100d40 2024-01-24T15:40:00.369 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:40:00.369 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14625,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/349535608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":349535608},{"type":"v1","addr":"172.21.15.160:6835","nonce":349535608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3072071447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3072071447},{"type":"v1","addr":"172.21.15.160:6833","nonce":3072071447}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/3525889833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3525889833},{"type":"v1","addr":"172.21.15.204:6833","nonce":3525889833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2310427373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2310427373},{"type":"v1","addr":"172.21.15.5:6835","nonce":2310427373}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2985908642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2985908642},{"type":"v1","addr":"172.21.15.5:6837","nonce":2985908642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24515,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/1401493351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1401493351},{"type":"v1","addr":"172.21.15.204:6835","nonce":1401493351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24541,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/2142560585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6836","nonce":2142560585},{"type":"v1","addr":"172.21.15.204:6837","nonce":2142560585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2024-01-24T15:40:00.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.369+0000 7fab84200700 1 -- 172.21.15.5:0/3096003996 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fab5c0a0570 msgr2=0x7fab5c0a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:00.371 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.369+0000 7fab84200700 1 --2- 172.21.15.5:0/3096003996 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fab5c0a0570 0x7fab5c0a2a30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fab64005950 tx=0x7fab6400b410 comp rx=0 tx=0).stop 2024-01-24T15:40:00.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.369+0000 7fab84200700 1 -- 172.21.15.5:0/3096003996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c100d40 msgr2=0x7fab7c074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:00.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.369+0000 7fab84200700 1 --2- 172.21.15.5:0/3096003996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c100d40 0x7fab7c074af0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00e970 tx=0x7fab6c00ec80 comp rx=0 tx=0).stop 2024-01-24T15:40:00.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.369+0000 7fab84200700 1 -- 172.21.15.5:0/3096003996 shutdown_connections 2024-01-24T15:40:00.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.369+0000 7fab84200700 1 --2- 172.21.15.5:0/3096003996 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fab7c1028d0 0x7fab7c073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:00.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.369+0000 7fab84200700 1 --2- 172.21.15.5:0/3096003996 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fab5c0a0570 0x7fab5c0a2a30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:00.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.369+0000 7fab84200700 1 --2- 172.21.15.5:0/3096003996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab7c100d40 0x7fab7c074af0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:00.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.369+0000 7fab84200700 1 --2- 172.21.15.5:0/3096003996 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab7c101f30 0x7fab7c073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:00.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.369+0000 7fab84200700 1 -- 172.21.15.5:0/3096003996 >> 172.21.15.5:0/3096003996 conn(0x7fab7c0fc270 msgr2=0x7fab7c1053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:00.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.369+0000 7fab84200700 1 -- 172.21.15.5:0/3096003996 shutdown_connections 2024-01-24T15:40:00.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:00.369+0000 7fab84200700 1 -- 172.21.15.5:0/3096003996 wait complete. 2024-01-24T15:40:00.373 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2024-01-24T15:40:00.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:00 smithi160 ceph-mon[38982]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:00.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:00 smithi160 ceph-mon[38982]: overall HEALTH_OK 2024-01-24T15:40:00.508 INFO:journalctl@ceph.mds.h.smithi160.stdout:Jan 24 15:40:00 smithi160 systemd[1]: Starting Ceph mds.h for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:40:00.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:00 smithi005 ceph-mon[35346]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:00.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:00 smithi005 ceph-mon[35346]: overall HEALTH_OK 2024-01-24T15:40:00.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:00 smithi204 ceph-mon[39634]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:00.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:00 smithi204 ceph-mon[39634]: overall HEALTH_OK 2024-01-24T15:40:01.007 INFO:journalctl@ceph.mds.h.smithi160.stdout:Jan 24 15:40:00 smithi160 ceph-mds[74842]: -- 172.21.15.160:0/1008658487 <== mon.2 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56285aee31e0 con 0x56285aebb000 2024-01-24T15:40:01.007 INFO:journalctl@ceph.mds.h.smithi160.stdout:Jan 24 15:40:00 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-h[74819]: starting mds.h at 2024-01-24T15:40:01.007 INFO:journalctl@ceph.mds.h.smithi160.stdout:Jan 24 15:40:00 smithi160 bash[74804]: e7238d1704846974c9f9b013ae8b505a3a41377544e192620db645573fb9ba1c 2024-01-24T15:40:01.007 INFO:journalctl@ceph.mds.h.smithi160.stdout:Jan 24 15:40:00 smithi160 systemd[1]: Started Ceph mds.h for bede0bb6-bacd-11ee-95b1-87774f69a715. 2024-01-24T15:40:01.560 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:01 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/3096003996' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:40:01.560 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:01 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:01.560 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:01 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:01.560 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:01 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:01.561 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:01 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:40:01.561 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:01 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:40:01.561 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:01 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:40:01.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:01 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/3096003996' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:40:01.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:01 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:01.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:01 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:01.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:01 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:01.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:01 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:40:01.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:01 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:40:01.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:01 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:40:01.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:01 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/3096003996' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:40:01.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:01 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:01.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:01 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:01.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:01 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:01.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:01 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:40:01.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:01 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:40:01.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:01 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:40:02.392 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T15:40:02.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.614+0000 7f70cb800700 1 -- 172.21.15.5:0/3845189859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70c41017a0 msgr2=0x7f70c4103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:02.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.614+0000 7f70cb800700 1 --2- 172.21.15.5:0/3845189859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70c41017a0 0x7f70c4103b90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f70b4009990 tx=0x7f70b4009ca0 comp rx=0 tx=0).stop 2024-01-24T15:40:02.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.614+0000 7f70cb800700 1 -- 172.21.15.5:0/3845189859 shutdown_connections 2024-01-24T15:40:02.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.614+0000 7f70cb800700 1 --2- 172.21.15.5:0/3845189859 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70c4106a00 0x7f70c4108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:02.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.614+0000 7f70cb800700 1 --2- 172.21.15.5:0/3845189859 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70c41017a0 0x7f70c4103b90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:02.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.614+0000 7f70cb800700 1 --2- 172.21.15.5:0/3845189859 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70c41040d0 0x7f70c41064c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:02.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.614+0000 7f70cb800700 1 -- 172.21.15.5:0/3845189859 >> 172.21.15.5:0/3845189859 conn(0x7f70c40fb170 msgr2=0x7f70c40fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:02.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.614+0000 7f70cb800700 1 -- 172.21.15.5:0/3845189859 shutdown_connections 2024-01-24T15:40:02.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.614+0000 7f70cb800700 1 -- 172.21.15.5:0/3845189859 wait complete. 2024-01-24T15:40:02.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.615+0000 7f70cb800700 1 Processor -- start 2024-01-24T15:40:02.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.615+0000 7f70cb800700 1 -- start start 2024-01-24T15:40:02.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.615+0000 7f70cb800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70c41017a0 0x7f70c4101110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:02.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.616+0000 7f70cb800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70c41040d0 0x7f70c40ff750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:02.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.616+0000 7f70cb800700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70c4106a00 0x7f70c40ffc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:02.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.616+0000 7f70cb800700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c4100430 con 0x7f70c41017a0 2024-01-24T15:40:02.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.616+0000 7f70cb800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c41005a0 con 0x7f70c41040d0 2024-01-24T15:40:02.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.616+0000 7f70cb800700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c41a0980 con 0x7f70c4106a00 2024-01-24T15:40:02.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.616+0000 7f70c8e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70c41017a0 0x7f70c4101110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:02.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.616+0000 7f70c8e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70c41017a0 0x7f70c4101110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51072/0 (socket says 172.21.15.5:51072) 2024-01-24T15:40:02.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.616+0000 7f70c8e00700 1 -- 172.21.15.5:0/4293057855 learned_addr learned my addr 172.21.15.5:0/4293057855 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:40:02.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.616+0000 7f70c3e00700 1 --2- 172.21.15.5:0/4293057855 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70c41040d0 0x7f70c40ff750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:02.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.616+0000 7f70c9800700 1 --2- 172.21.15.5:0/4293057855 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70c4106a00 0x7f70c40ffc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:02.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.616+0000 7f70c8e00700 1 -- 172.21.15.5:0/4293057855 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70c4106a00 msgr2=0x7f70c40ffc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:02.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.616+0000 7f70c8e00700 1 --2- 172.21.15.5:0/4293057855 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70c4106a00 0x7f70c40ffc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:02.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.616+0000 7f70c8e00700 1 -- 172.21.15.5:0/4293057855 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70c41040d0 msgr2=0x7f70c40ff750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:02.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.616+0000 7f70c8e00700 1 --2- 172.21.15.5:0/4293057855 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70c41040d0 0x7f70c40ff750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:02.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.616+0000 7f70c8e00700 1 -- 172.21.15.5:0/4293057855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b40095f0 con 0x7f70c41017a0 2024-01-24T15:40:02.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.616+0000 7f70c3e00700 1 --2- 172.21.15.5:0/4293057855 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70c41040d0 0x7f70c40ff750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T15:40:02.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.616+0000 7f70c8e00700 1 --2- 172.21.15.5:0/4293057855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70c41017a0 0x7f70c4101110 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f70b4005910 tx=0x7f70b4005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:02.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.617+0000 7f70c1600700 1 -- 172.21.15.5:0/4293057855 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b401d070 con 0x7f70c41017a0 2024-01-24T15:40:02.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.617+0000 7f70c1600700 1 -- 172.21.15.5:0/4293057855 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70b4022470 con 0x7f70c41017a0 2024-01-24T15:40:02.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.617+0000 7f70cb800700 1 -- 172.21.15.5:0/4293057855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c41a0c00 con 0x7f70c41017a0 2024-01-24T15:40:02.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.617+0000 7f70c1600700 1 -- 172.21.15.5:0/4293057855 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b4022ea0 con 0x7f70c41017a0 2024-01-24T15:40:02.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.617+0000 7f70cb800700 1 -- 172.21.15.5:0/4293057855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c41a1080 con 0x7f70c41017a0 2024-01-24T15:40:02.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.618+0000 7f70cb800700 1 -- 172.21.15.5:0/4293057855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70c40fccf0 con 0x7f70c41017a0 2024-01-24T15:40:02.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.620+0000 7f70c1600700 1 -- 172.21.15.5:0/4293057855 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f70b400ba60 con 0x7f70c41017a0 2024-01-24T15:40:02.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.621+0000 7f70c1600700 1 --2- 172.21.15.5:0/4293057855 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f70a40a05f0 0x7f70a40a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:02.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.621+0000 7f70c1600700 1 -- 172.21.15.5:0/4293057855 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f70b40ccc70 con 0x7f70c41017a0 2024-01-24T15:40:02.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.621+0000 7f70c3e00700 1 --2- 172.21.15.5:0/4293057855 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f70a40a05f0 0x7f70a40a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:02.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.622+0000 7f70c3e00700 1 --2- 172.21.15.5:0/4293057855 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f70a40a05f0 0x7f70a40a2ab0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f70ac011490 tx=0x7f70ac009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:02.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.623+0000 7f70c1600700 1 -- 172.21.15.5:0/4293057855 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f70b4096ca0 con 0x7f70c41017a0 2024-01-24T15:40:02.649 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:02 smithi160 ceph-mon[38982]: Deploying daemon mds.i on smithi204 2024-01-24T15:40:02.650 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:02 smithi160 ceph-mon[38982]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:02.650 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:02 smithi160 ceph-mon[38982]: mds.? [v2:172.21.15.160:6836/2022828845,v1:172.21.15.160:6837/2022828845] up:boot 2024-01-24T15:40:02.650 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:02 smithi160 ceph-mon[38982]: fsmap 8 up:standby 2024-01-24T15:40:02.650 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:02 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-01-24T15:40:02.668 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:02 smithi204 ceph-mon[39634]: Deploying daemon mds.i on smithi204 2024-01-24T15:40:02.668 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:02 smithi204 ceph-mon[39634]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:02.669 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:02 smithi204 ceph-mon[39634]: mds.? [v2:172.21.15.160:6836/2022828845,v1:172.21.15.160:6837/2022828845] up:boot 2024-01-24T15:40:02.669 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:02 smithi204 ceph-mon[39634]: fsmap 8 up:standby 2024-01-24T15:40:02.669 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:02 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-01-24T15:40:02.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:02 smithi005 ceph-mon[35346]: Deploying daemon mds.i on smithi204 2024-01-24T15:40:02.682 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:02 smithi005 ceph-mon[35346]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:02.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:02 smithi005 ceph-mon[35346]: mds.? [v2:172.21.15.160:6836/2022828845,v1:172.21.15.160:6837/2022828845] up:boot 2024-01-24T15:40:02.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:02 smithi005 ceph-mon[35346]: fsmap 8 up:standby 2024-01-24T15:40:02.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:02 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-01-24T15:40:02.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.886+0000 7f70cb800700 1 -- 172.21.15.5:0/4293057855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70c402cc70 con 0x7f70c41017a0 2024-01-24T15:40:02.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.887+0000 7f70c1600700 1 -- 172.21.15.5:0/4293057855 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6565 (secure 0 0 0) 0x7f70b409a2c0 con 0x7f70c41017a0 2024-01-24T15:40:02.890 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:40:02.890 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14625,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/349535608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":349535608},{"type":"v1","addr":"172.21.15.160:6835","nonce":349535608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3072071447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3072071447},{"type":"v1","addr":"172.21.15.160:6833","nonce":3072071447}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/3525889833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3525889833},{"type":"v1","addr":"172.21.15.204:6833","nonce":3525889833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2310427373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2310427373},{"type":"v1","addr":"172.21.15.5:6835","nonce":2310427373}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2985908642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2985908642},{"type":"v1","addr":"172.21.15.5:6837","nonce":2985908642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24515,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/1401493351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1401493351},{"type":"v1","addr":"172.21.15.204:6835","nonce":1401493351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2022828845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2022828845},{"type":"v1","addr":"172.21.15.160:6837","nonce":2022828845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24541,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/2142560585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6836","nonce":2142560585},{"type":"v1","addr":"172.21.15.204:6837","nonce":2142560585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2024-01-24T15:40:02.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.889+0000 7f70cb800700 1 -- 172.21.15.5:0/4293057855 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f70a40a05f0 msgr2=0x7f70a40a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:02.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.889+0000 7f70cb800700 1 --2- 172.21.15.5:0/4293057855 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f70a40a05f0 0x7f70a40a2ab0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f70ac011490 tx=0x7f70ac009260 comp rx=0 tx=0).stop 2024-01-24T15:40:02.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.889+0000 7f70cb800700 1 -- 172.21.15.5:0/4293057855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70c41017a0 msgr2=0x7f70c4101110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:02.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.889+0000 7f70cb800700 1 --2- 172.21.15.5:0/4293057855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70c41017a0 0x7f70c4101110 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f70b4005910 tx=0x7f70b4005720 comp rx=0 tx=0).stop 2024-01-24T15:40:02.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.889+0000 7f70cb800700 1 -- 172.21.15.5:0/4293057855 shutdown_connections 2024-01-24T15:40:02.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.889+0000 7f70cb800700 1 --2- 172.21.15.5:0/4293057855 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f70c4106a00 0x7f70c40ffc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:02.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.889+0000 7f70cb800700 1 --2- 172.21.15.5:0/4293057855 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f70a40a05f0 0x7f70a40a2ab0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:02.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.889+0000 7f70cb800700 1 --2- 172.21.15.5:0/4293057855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f70c41017a0 0x7f70c4101110 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:02.893 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.889+0000 7f70cb800700 1 --2- 172.21.15.5:0/4293057855 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70c41040d0 0x7f70c40ff750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:02.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.889+0000 7f70cb800700 1 -- 172.21.15.5:0/4293057855 >> 172.21.15.5:0/4293057855 conn(0x7f70c40fb170 msgr2=0x7f70c4102410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:02.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.889+0000 7f70cb800700 1 -- 172.21.15.5:0/4293057855 shutdown_connections 2024-01-24T15:40:02.894 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:02.889+0000 7f70cb800700 1 -- 172.21.15.5:0/4293057855 wait complete. 2024-01-24T15:40:02.895 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2024-01-24T15:40:03.225 INFO:journalctl@ceph.mds.i.smithi204.stdout:Jan 24 15:40:02 smithi204 systemd[1]: Starting Ceph mds.i for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:40:03.683 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:03 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/4293057855' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:40:03.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:03 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/4293057855' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:40:03.725 INFO:journalctl@ceph.mds.i.smithi204.stdout:Jan 24 15:40:03 smithi204 ceph-mds[76217]: -- 172.21.15.204:0/2041920989 <== mon.1 v2:172.21.15.204:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55917f36d1e0 con 0x55917f344800 2024-01-24T15:40:03.725 INFO:journalctl@ceph.mds.i.smithi204.stdout:Jan 24 15:40:03 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-i[76194]: starting mds.i at 2024-01-24T15:40:03.725 INFO:journalctl@ceph.mds.i.smithi204.stdout:Jan 24 15:40:03 smithi204 bash[76179]: 3dbfbef38a9c695018d3a4d5ddd9c87815164314e0008b10390ea903d74898de 2024-01-24T15:40:03.725 INFO:journalctl@ceph.mds.i.smithi204.stdout:Jan 24 15:40:03 smithi204 systemd[1]: Started Ceph mds.i for bede0bb6-bacd-11ee-95b1-87774f69a715. 2024-01-24T15:40:03.756 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:03 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/4293057855' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:40:04.822 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:04 smithi005 ceph-mon[35346]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:04.822 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:04 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:04.823 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:04 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:04.823 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:04 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:04.823 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:04 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:40:04.823 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:04 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:40:04.823 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:04 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:40:04.823 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:04 smithi005 ceph-mon[35346]: mds.? [v2:172.21.15.204:6838/3704737145,v1:172.21.15.204:6839/3704737145] up:boot 2024-01-24T15:40:04.823 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:04 smithi005 ceph-mon[35346]: fsmap 9 up:standby 2024-01-24T15:40:04.823 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:04 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-01-24T15:40:04.911 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T15:40:04.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:04 smithi204 ceph-mon[39634]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:04.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:04 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:04.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:04 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:04.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:04 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:04.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:04 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:40:04.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:04 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:40:04.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:04 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:40:04.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:04 smithi204 ceph-mon[39634]: mds.? [v2:172.21.15.204:6838/3704737145,v1:172.21.15.204:6839/3704737145] up:boot 2024-01-24T15:40:04.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:04 smithi204 ceph-mon[39634]: fsmap 9 up:standby 2024-01-24T15:40:04.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:04 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-01-24T15:40:05.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:04 smithi160 ceph-mon[38982]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:05.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:04 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:05.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:04 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:05.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:04 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:05.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:04 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:40:05.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:04 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:40:05.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:04 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:40:05.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:04 smithi160 ceph-mon[38982]: mds.? [v2:172.21.15.204:6838/3704737145,v1:172.21.15.204:6839/3704737145] up:boot 2024-01-24T15:40:05.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:04 smithi160 ceph-mon[38982]: fsmap 9 up:standby 2024-01-24T15:40:05.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:04 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-01-24T15:40:05.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.200+0000 7f6fbca00700 1 -- 172.21.15.5:0/2361822577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fb4101f30 msgr2=0x7f6fb4102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:05.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.200+0000 7f6fbca00700 1 --2- 172.21.15.5:0/2361822577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fb4101f30 0x7f6fb4102390 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c0099c0 tx=0x7f6f9c009cd0 comp rx=0 tx=0).stop 2024-01-24T15:40:05.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.200+0000 7f6fbca00700 1 -- 172.21.15.5:0/2361822577 shutdown_connections 2024-01-24T15:40:05.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.200+0000 7f6fbca00700 1 --2- 172.21.15.5:0/2361822577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fb41028d0 0x7f6fb4109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:05.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.200+0000 7f6fbca00700 1 --2- 172.21.15.5:0/2361822577 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6fb4100d40 0x7f6fb4101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:05.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.200+0000 7f6fbca00700 1 --2- 172.21.15.5:0/2361822577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fb4101f30 0x7f6fb4102390 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:05.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.200+0000 7f6fbca00700 1 -- 172.21.15.5:0/2361822577 >> 172.21.15.5:0/2361822577 conn(0x7f6fb40fc270 msgr2=0x7f6fb40fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:05.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.200+0000 7f6fbca00700 1 -- 172.21.15.5:0/2361822577 shutdown_connections 2024-01-24T15:40:05.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.200+0000 7f6fbca00700 1 -- 172.21.15.5:0/2361822577 wait complete. 2024-01-24T15:40:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.202+0000 7f6fbca00700 1 Processor -- start 2024-01-24T15:40:05.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.202+0000 7f6fbca00700 1 -- start start 2024-01-24T15:40:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.202+0000 7f6fbca00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fb4100d40 0x7f6fb4196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.202+0000 7f6fbca00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fb4101f30 0x7f6fb4196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.202+0000 7f6fbca00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6fb41028d0 0x7f6fb419df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.202+0000 7f6fbca00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb419e4d0 con 0x7f6fb4101f30 2024-01-24T15:40:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.202+0000 7f6fbca00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb419e610 con 0x7f6fb4100d40 2024-01-24T15:40:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.202+0000 7f6fbca00700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb419e7a0 con 0x7f6fb41028d0 2024-01-24T15:40:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.202+0000 7f6fb9600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fb4101f30 0x7f6fb4196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.202+0000 7f6fba000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fb4100d40 0x7f6fb4196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:05.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.202+0000 7f6fb9600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fb4101f30 0x7f6fb4196e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51084/0 (socket says 172.21.15.5:51084) 2024-01-24T15:40:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.202+0000 7f6fb9600700 1 -- 172.21.15.5:0/4283741770 learned_addr learned my addr 172.21.15.5:0/4283741770 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:40:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.202+0000 7f6fba000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fb4100d40 0x7f6fb4196950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.5:38268/0 (socket says 172.21.15.5:38268) 2024-01-24T15:40:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.203+0000 7f6fbaa00700 1 --2- 172.21.15.5:0/4283741770 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6fb41028d0 0x7f6fb419df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.203+0000 7f6fba000700 1 -- 172.21.15.5:0/4283741770 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6fb41028d0 msgr2=0x7f6fb419df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.203+0000 7f6fba000700 1 --2- 172.21.15.5:0/4283741770 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6fb41028d0 0x7f6fb419df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.203+0000 7f6fba000700 1 -- 172.21.15.5:0/4283741770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fb4101f30 msgr2=0x7f6fb4196e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.203+0000 7f6fba000700 1 --2- 172.21.15.5:0/4283741770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fb4101f30 0x7f6fb4196e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.203+0000 7f6fba000700 1 -- 172.21.15.5:0/4283741770 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac009c40 con 0x7f6fb4100d40 2024-01-24T15:40:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.203+0000 7f6fbaa00700 1 --2- 172.21.15.5:0/4283741770 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6fb41028d0 0x7f6fb419df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T15:40:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.203+0000 7f6fb9600700 1 --2- 172.21.15.5:0/4283741770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fb4101f30 0x7f6fb4196e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T15:40:05.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.203+0000 7f6fba000700 1 --2- 172.21.15.5:0/4283741770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fb4100d40 0x7f6fb4196950 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6fa400e9c0 tx=0x7f6fa400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.203+0000 7f6fb2a00700 1 -- 172.21.15.5:0/4283741770 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa400cbd0 con 0x7f6fb4100d40 2024-01-24T15:40:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.203+0000 7f6fbca00700 1 -- 172.21.15.5:0/4283741770 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f9c0095f0 con 0x7f6fb4100d40 2024-01-24T15:40:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.203+0000 7f6fb2a00700 1 -- 172.21.15.5:0/4283741770 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6fa400eeb0 con 0x7f6fb4100d40 2024-01-24T15:40:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.203+0000 7f6fb2a00700 1 -- 172.21.15.5:0/4283741770 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa4003c40 con 0x7f6fb4100d40 2024-01-24T15:40:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.204+0000 7f6fbca00700 1 -- 172.21.15.5:0/4283741770 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb419ee50 con 0x7f6fb4100d40 2024-01-24T15:40:05.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.205+0000 7f6fbca00700 1 -- 172.21.15.5:0/4283741770 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb4108320 con 0x7f6fb4100d40 2024-01-24T15:40:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.207+0000 7f6fb2a00700 1 -- 172.21.15.5:0/4283741770 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f6fa4004870 con 0x7f6fb4100d40 2024-01-24T15:40:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.208+0000 7f6fb2a00700 1 --2- 172.21.15.5:0/4283741770 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f6f940a0570 0x7f6f940a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:05.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.208+0000 7f6fb2a00700 1 -- 172.21.15.5:0/4283741770 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6fa4014070 con 0x7f6fb4100d40 2024-01-24T15:40:05.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.208+0000 7f6fb9600700 1 --2- 172.21.15.5:0/4283741770 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f6f940a0570 0x7f6f940a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:05.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.209+0000 7f6fb9600700 1 --2- 172.21.15.5:0/4283741770 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f6f940a0570 0x7f6f940a2a30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c005b20 tx=0x7f6f9c01a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:05.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.211+0000 7f6fb2a00700 1 -- 172.21.15.5:0/4283741770 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f6fa40958e0 con 0x7f6fb4100d40 2024-01-24T15:40:05.374 INFO:journalctl@ceph.mds.g.smithi005.stdout:Jan 24 15:40:05 smithi005 systemd[1]: Starting Ceph mds.g for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:40:05.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.482+0000 7f6fbca00700 1 -- 172.21.15.5:0/4283741770 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6fb419ea80 con 0x7f6fb4100d40 2024-01-24T15:40:05.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.483+0000 7f6fb2a00700 1 -- 172.21.15.5:0/4283741770 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7327 (secure 0 0 0) 0x7f6fb419ea80 con 0x7f6fb4100d40 2024-01-24T15:40:05.485 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:40:05.486 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14625,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/349535608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":349535608},{"type":"v1","addr":"172.21.15.160:6835","nonce":349535608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3072071447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3072071447},{"type":"v1","addr":"172.21.15.160:6833","nonce":3072071447}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/3525889833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3525889833},{"type":"v1","addr":"172.21.15.204:6833","nonce":3525889833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2310427373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2310427373},{"type":"v1","addr":"172.21.15.5:6835","nonce":2310427373}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2985908642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2985908642},{"type":"v1","addr":"172.21.15.5:6837","nonce":2985908642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24515,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/1401493351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1401493351},{"type":"v1","addr":"172.21.15.204:6835","nonce":1401493351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2022828845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2022828845},{"type":"v1","addr":"172.21.15.160:6837","nonce":2022828845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24541,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/2142560585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6836","nonce":2142560585},{"type":"v1","addr":"172.21.15.204:6837","nonce":2142560585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24562,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6839/3704737145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6838","nonce":3704737145},{"type":"v1","addr":"172.21.15.204:6839","nonce":3704737145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-01-24T15:40:05.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.486+0000 7f6fbca00700 1 -- 172.21.15.5:0/4283741770 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f6f940a0570 msgr2=0x7f6f940a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:05.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.486+0000 7f6fbca00700 1 --2- 172.21.15.5:0/4283741770 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f6f940a0570 0x7f6f940a2a30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6f9c005b20 tx=0x7f6f9c01a040 comp rx=0 tx=0).stop 2024-01-24T15:40:05.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.486+0000 7f6fbca00700 1 -- 172.21.15.5:0/4283741770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fb4100d40 msgr2=0x7f6fb4196950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:05.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.486+0000 7f6fbca00700 1 --2- 172.21.15.5:0/4283741770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fb4100d40 0x7f6fb4196950 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6fa400e9c0 tx=0x7f6fa400ecd0 comp rx=0 tx=0).stop 2024-01-24T15:40:05.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.486+0000 7f6fbca00700 1 -- 172.21.15.5:0/4283741770 shutdown_connections 2024-01-24T15:40:05.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.486+0000 7f6fbca00700 1 --2- 172.21.15.5:0/4283741770 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f6fb41028d0 0x7f6fb419df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:05.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.486+0000 7f6fbca00700 1 --2- 172.21.15.5:0/4283741770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fb4100d40 0x7f6fb4196950 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:05.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.486+0000 7f6fbca00700 1 --2- 172.21.15.5:0/4283741770 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f6f940a0570 0x7f6f940a2a30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:05.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.486+0000 7f6fbca00700 1 --2- 172.21.15.5:0/4283741770 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6fb4101f30 0x7f6fb4196e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:05.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.486+0000 7f6fbca00700 1 -- 172.21.15.5:0/4283741770 >> 172.21.15.5:0/4283741770 conn(0x7f6fb40fc270 msgr2=0x7f6fb4105460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:05.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.486+0000 7f6fbca00700 1 -- 172.21.15.5:0/4283741770 shutdown_connections 2024-01-24T15:40:05.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:05.486+0000 7f6fbca00700 1 -- 172.21.15.5:0/4283741770 wait complete. 2024-01-24T15:40:05.490 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 10 2024-01-24T15:40:05.879 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:05 smithi005 ceph-mon[35346]: Deploying daemon mds.g on smithi005 2024-01-24T15:40:05.879 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:05 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/4283741770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:40:05.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:05 smithi204 ceph-mon[39634]: Deploying daemon mds.g on smithi005 2024-01-24T15:40:05.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:05 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/4283741770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:40:06.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:05 smithi160 ceph-mon[38982]: Deploying daemon mds.g on smithi005 2024-01-24T15:40:06.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:05 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/4283741770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:40:06.183 INFO:journalctl@ceph.mds.g.smithi005.stdout:Jan 24 15:40:05 smithi005 bash[85718]: 8dfc109e6ffcb670aa80c5b6f74f8ba1d4811ac9675545eda39d95fb8db7a41f 2024-01-24T15:40:06.183 INFO:journalctl@ceph.mds.g.smithi005.stdout:Jan 24 15:40:05 smithi005 systemd[1]: Started Ceph mds.g for bede0bb6-bacd-11ee-95b1-87774f69a715. 2024-01-24T15:40:06.183 INFO:journalctl@ceph.mds.g.smithi005.stdout:Jan 24 15:40:05 smithi005 ceph-mds[85756]: -- 172.21.15.5:0/189555748 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e7016491e0 con 0x55e701621000 2024-01-24T15:40:06.183 INFO:journalctl@ceph.mds.g.smithi005.stdout:Jan 24 15:40:05 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-g[85733]: starting mds.g at 2024-01-24T15:40:06.931 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:06 smithi005 ceph-mon[35346]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:06.931 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:06 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:06.931 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:06 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:06.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:06 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:06.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:06 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:40:06.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:06 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:40:06.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:06 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:40:06.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:06 smithi204 ceph-mon[39634]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:06.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:06 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:06.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:06 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:06.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:06 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:06.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:06 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:40:06.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:06 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:40:06.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:06 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:40:07.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:06 smithi160 ceph-mon[38982]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:07.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:06 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:07.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:06 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:07.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:06 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:07.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:06 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:40:07.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:06 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:40:07.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:06 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:40:07.509 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T15:40:07.739 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:07 smithi005 ceph-mon[35346]: Deploying daemon mds.a on smithi005 2024-01-24T15:40:07.739 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:07 smithi005 ceph-mon[35346]: mds.? [v2:172.21.15.5:6838/1626257631,v1:172.21.15.5:6839/1626257631] up:boot 2024-01-24T15:40:07.739 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:07 smithi005 ceph-mon[35346]: fsmap 10 up:standby 2024-01-24T15:40:07.739 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:07 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-01-24T15:40:07.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.869+0000 7f511c200700 1 -- 172.21.15.5:0/834156218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51140737a0 msgr2=0x7f5114073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:07.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.869+0000 7f511c200700 1 --2- 172.21.15.5:0/834156218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51140737a0 0x7f5114073c20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f50fc009990 tx=0x7f50fc009ca0 comp rx=0 tx=0).stop 2024-01-24T15:40:07.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.869+0000 7f511c200700 1 -- 172.21.15.5:0/834156218 shutdown_connections 2024-01-24T15:40:07.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.869+0000 7f511c200700 1 --2- 172.21.15.5:0/834156218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5114108c10 0x7f511410b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:07.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.869+0000 7f511c200700 1 --2- 172.21.15.5:0/834156218 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5114074d80 0x7f51140731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:07.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.869+0000 7f511c200700 1 --2- 172.21.15.5:0/834156218 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f51140737a0 0x7f5114073c20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:07.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.869+0000 7f511c200700 1 -- 172.21.15.5:0/834156218 >> 172.21.15.5:0/834156218 conn(0x7f51140fc280 msgr2=0x7f51140fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:07.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.869+0000 7f511c200700 1 -- 172.21.15.5:0/834156218 shutdown_connections 2024-01-24T15:40:07.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.869+0000 7f511c200700 1 -- 172.21.15.5:0/834156218 wait complete. 2024-01-24T15:40:07.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.870+0000 7f511c200700 1 Processor -- start 2024-01-24T15:40:07.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.870+0000 7f511c200700 1 -- start start 2024-01-24T15:40:07.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.871+0000 7f511c200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51140737a0 0x7f5114198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:07.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.871+0000 7f511c200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5114074d80 0x7f51141990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:07.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.871+0000 7f511c200700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5114108c10 0x7f51141a0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:07.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.871+0000 7f511c200700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51141a06f0 con 0x7f5114074d80 2024-01-24T15:40:07.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.871+0000 7f511c200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51141a0830 con 0x7f51140737a0 2024-01-24T15:40:07.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.871+0000 7f511c200700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51141a09c0 con 0x7f5114108c10 2024-01-24T15:40:07.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.871+0000 7f5119800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51140737a0 0x7f5114198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:07.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.871+0000 7f5118e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5114074d80 0x7f51141990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:07.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.871+0000 7f5119800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51140737a0 0x7f5114198b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.5:38292/0 (socket says 172.21.15.5:38292) 2024-01-24T15:40:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.871+0000 7f5119800700 1 -- 172.21.15.5:0/2377855083 learned_addr learned my addr 172.21.15.5:0/2377855083 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:40:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.871+0000 7f511a200700 1 --2- 172.21.15.5:0/2377855083 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5114108c10 0x7f51141a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.872+0000 7f5119800700 1 -- 172.21.15.5:0/2377855083 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5114108c10 msgr2=0x7f51141a0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.872+0000 7f5119800700 1 --2- 172.21.15.5:0/2377855083 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5114108c10 0x7f51141a0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.872+0000 7f5119800700 1 -- 172.21.15.5:0/2377855083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5114074d80 msgr2=0x7f51141990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.872+0000 7f5119800700 1 --2- 172.21.15.5:0/2377855083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5114074d80 0x7f51141990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.872+0000 7f5119800700 1 -- 172.21.15.5:0/2377855083 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c009c40 con 0x7f51140737a0 2024-01-24T15:40:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.872+0000 7f5118e00700 1 --2- 172.21.15.5:0/2377855083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5114074d80 0x7f51141990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T15:40:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.872+0000 7f5119800700 1 --2- 172.21.15.5:0/2377855083 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51140737a0 0x7f5114198b70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f510400d950 tx=0x7f510400dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.872+0000 7f5112000700 1 -- 172.21.15.5:0/2377855083 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5104009940 con 0x7f51140737a0 2024-01-24T15:40:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.872+0000 7f511c200700 1 -- 172.21.15.5:0/2377855083 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50fc0095f0 con 0x7f51140737a0 2024-01-24T15:40:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.872+0000 7f5112000700 1 -- 172.21.15.5:0/2377855083 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5104010460 con 0x7f51140737a0 2024-01-24T15:40:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.872+0000 7f5112000700 1 -- 172.21.15.5:0/2377855083 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510400f620 con 0x7f51140737a0 2024-01-24T15:40:07.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.872+0000 7f511c200700 1 -- 172.21.15.5:0/2377855083 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51141a1070 con 0x7f51140737a0 2024-01-24T15:40:07.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.874+0000 7f511c200700 1 -- 172.21.15.5:0/2377855083 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51141072c0 con 0x7f51140737a0 2024-01-24T15:40:07.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.875+0000 7f5112000700 1 -- 172.21.15.5:0/2377855083 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f51040105d0 con 0x7f51140737a0 2024-01-24T15:40:07.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.876+0000 7f5112000700 1 --2- 172.21.15.5:0/2377855083 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f50f40a05f0 0x7f50f40a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:07.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.877+0000 7f5112000700 1 -- 172.21.15.5:0/2377855083 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f51040cb360 con 0x7f51140737a0 2024-01-24T15:40:07.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.877+0000 7f5118e00700 1 --2- 172.21.15.5:0/2377855083 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f50f40a05f0 0x7f50f40a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:07.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.877+0000 7f5118e00700 1 --2- 172.21.15.5:0/2377855083 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f50f40a05f0 0x7f50f40a2ab0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0098e0 tx=0x7f50fc00b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:07.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:07.880+0000 7f5112000700 1 -- 172.21.15.5:0/2377855083 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f5104095300 con 0x7f51140737a0 2024-01-24T15:40:07.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:07 smithi204 ceph-mon[39634]: Deploying daemon mds.a on smithi005 2024-01-24T15:40:07.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:07 smithi204 ceph-mon[39634]: mds.? [v2:172.21.15.5:6838/1626257631,v1:172.21.15.5:6839/1626257631] up:boot 2024-01-24T15:40:07.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:07 smithi204 ceph-mon[39634]: fsmap 10 up:standby 2024-01-24T15:40:07.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:07 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-01-24T15:40:08.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:07 smithi160 ceph-mon[38982]: Deploying daemon mds.a on smithi005 2024-01-24T15:40:08.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:07 smithi160 ceph-mon[38982]: mds.? [v2:172.21.15.5:6838/1626257631,v1:172.21.15.5:6839/1626257631] up:boot 2024-01-24T15:40:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:07 smithi160 ceph-mon[38982]: fsmap 10 up:standby 2024-01-24T15:40:08.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:07 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-01-24T15:40:08.150 INFO:journalctl@ceph.mds.a.smithi005.stdout:Jan 24 15:40:07 smithi005 systemd[1]: Starting Ceph mds.a for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:40:08.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:08.167+0000 7f511c200700 1 -- 172.21.15.5:0/2377855083 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f511402cc70 con 0x7f51140737a0 2024-01-24T15:40:08.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:08.168+0000 7f5112000700 1 -- 172.21.15.5:0/2377855083 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8082 (secure 0 0 0) 0x7f5104098920 con 0x7f51140737a0 2024-01-24T15:40:08.171 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:40:08.171 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14625,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/349535608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":349535608},{"type":"v1","addr":"172.21.15.160:6835","nonce":349535608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3072071447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3072071447},{"type":"v1","addr":"172.21.15.160:6833","nonce":3072071447}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/3525889833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3525889833},{"type":"v1","addr":"172.21.15.204:6833","nonce":3525889833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2310427373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2310427373},{"type":"v1","addr":"172.21.15.5:6835","nonce":2310427373}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2985908642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2985908642},{"type":"v1","addr":"172.21.15.5:6837","nonce":2985908642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24515,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/1401493351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1401493351},{"type":"v1","addr":"172.21.15.204:6835","nonce":1401493351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2022828845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2022828845},{"type":"v1","addr":"172.21.15.160:6837","nonce":2022828845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24541,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/2142560585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6836","nonce":2142560585},{"type":"v1","addr":"172.21.15.204:6837","nonce":2142560585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24562,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6839/3704737145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6838","nonce":3704737145},{"type":"v1","addr":"172.21.15.204:6839","nonce":3704737145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24563,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/1626257631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":1626257631},{"type":"v1","addr":"172.21.15.5:6839","nonce":1626257631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[]} 2024-01-24T15:40:08.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:08.170+0000 7f511c200700 1 -- 172.21.15.5:0/2377855083 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f50f40a05f0 msgr2=0x7f50f40a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:08.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:08.170+0000 7f511c200700 1 --2- 172.21.15.5:0/2377855083 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f50f40a05f0 0x7f50f40a2ab0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0098e0 tx=0x7f50fc00b260 comp rx=0 tx=0).stop 2024-01-24T15:40:08.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:08.170+0000 7f511c200700 1 -- 172.21.15.5:0/2377855083 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51140737a0 msgr2=0x7f5114198b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:08.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:08.170+0000 7f511c200700 1 --2- 172.21.15.5:0/2377855083 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51140737a0 0x7f5114198b70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f510400d950 tx=0x7f510400dc60 comp rx=0 tx=0).stop 2024-01-24T15:40:08.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:08.170+0000 7f511c200700 1 -- 172.21.15.5:0/2377855083 shutdown_connections 2024-01-24T15:40:08.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:08.170+0000 7f511c200700 1 --2- 172.21.15.5:0/2377855083 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5114108c10 0x7f51141a0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:08.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:08.171+0000 7f511c200700 1 --2- 172.21.15.5:0/2377855083 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51140737a0 0x7f5114198b70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:08.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:08.171+0000 7f511c200700 1 --2- 172.21.15.5:0/2377855083 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f50f40a05f0 0x7f50f40a2ab0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:08.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:08.171+0000 7f511c200700 1 --2- 172.21.15.5:0/2377855083 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5114074d80 0x7f51141990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:08.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:08.171+0000 7f511c200700 1 -- 172.21.15.5:0/2377855083 >> 172.21.15.5:0/2377855083 conn(0x7f51140fc280 msgr2=0x7f51140fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:08.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:08.171+0000 7f511c200700 1 -- 172.21.15.5:0/2377855083 shutdown_connections 2024-01-24T15:40:08.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:08.171+0000 7f511c200700 1 -- 172.21.15.5:0/2377855083 wait complete. 2024-01-24T15:40:08.174 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 11 2024-01-24T15:40:08.590 INFO:journalctl@ceph.mds.a.smithi005.stdout:Jan 24 15:40:08 smithi005 bash[86102]: e758923d10eef947a7607faaf9ea45aeab0bc911a1dd71e3aff80cac9e1c9625 2024-01-24T15:40:08.590 INFO:journalctl@ceph.mds.a.smithi005.stdout:Jan 24 15:40:08 smithi005 systemd[1]: Started Ceph mds.a for bede0bb6-bacd-11ee-95b1-87774f69a715. 2024-01-24T15:40:08.590 INFO:journalctl@ceph.mds.a.smithi005.stdout:Jan 24 15:40:08 smithi005 ceph-mds[86142]: -- 172.21.15.5:0/4185856723 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5560fad191e0 con 0x5560facf1000 2024-01-24T15:40:08.590 INFO:journalctl@ceph.mds.a.smithi005.stdout:Jan 24 15:40:08 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-a[86117]: starting mds.a at 2024-01-24T15:40:08.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:08 smithi160 ceph-mon[38982]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:08.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:08 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/2377855083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:40:08.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:08 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:08.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:08 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:08.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:08 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:08.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:08 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:40:08.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:08 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:40:08.757 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:08 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:40:08.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:08 smithi005 ceph-mon[35346]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:08.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:08 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/2377855083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:40:08.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:08 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:08.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:08 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:08.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:08 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:08.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:08 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:40:08.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:08 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:40:08.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:08 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:40:08.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:08 smithi204 ceph-mon[39634]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:08.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:08 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/2377855083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:40:08.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:08 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:08.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:08 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:08.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:08 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:08.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:08 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-24T15:40:08.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:08 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-24T15:40:08.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:08 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:40:09.625 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:09 smithi160 ceph-mon[38982]: Deploying daemon mds.b on smithi160 2024-01-24T15:40:09.625 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:09 smithi160 ceph-mon[38982]: mds.? [v2:172.21.15.5:6840/3768781825,v1:172.21.15.5:6841/3768781825] up:boot 2024-01-24T15:40:09.625 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:09 smithi160 ceph-mon[38982]: fsmap 11 up:standby 2024-01-24T15:40:09.625 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:09 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-24T15:40:09.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:09 smithi005 ceph-mon[35346]: Deploying daemon mds.b on smithi160 2024-01-24T15:40:09.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:09 smithi005 ceph-mon[35346]: mds.? [v2:172.21.15.5:6840/3768781825,v1:172.21.15.5:6841/3768781825] up:boot 2024-01-24T15:40:09.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:09 smithi005 ceph-mon[35346]: fsmap 11 up:standby 2024-01-24T15:40:09.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:09 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-24T15:40:09.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:09 smithi204 ceph-mon[39634]: Deploying daemon mds.b on smithi160 2024-01-24T15:40:09.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:09 smithi204 ceph-mon[39634]: mds.? [v2:172.21.15.5:6840/3768781825,v1:172.21.15.5:6841/3768781825] up:boot 2024-01-24T15:40:09.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:09 smithi204 ceph-mon[39634]: fsmap 11 up:standby 2024-01-24T15:40:09.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:09 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-24T15:40:10.197 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T15:40:10.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.407+0000 7fcce9e00700 1 -- 172.21.15.5:0/3330652843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcce4100d40 msgr2=0x7fcce4101160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:10.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.407+0000 7fcce9e00700 1 --2- 172.21.15.5:0/3330652843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcce4100d40 0x7fcce4101160 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fccd40099c0 tx=0x7fccd4009cd0 comp rx=0 tx=0).stop 2024-01-24T15:40:10.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.407+0000 7fcce9e00700 1 -- 172.21.15.5:0/3330652843 shutdown_connections 2024-01-24T15:40:10.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.407+0000 7fcce9e00700 1 --2- 172.21.15.5:0/3330652843 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce41028d0 0x7fcce4109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:10.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.407+0000 7fcce9e00700 1 --2- 172.21.15.5:0/3330652843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcce4100d40 0x7fcce4101160 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:10.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.407+0000 7fcce9e00700 1 --2- 172.21.15.5:0/3330652843 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcce4101f30 0x7fcce4102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:10.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.407+0000 7fcce9e00700 1 -- 172.21.15.5:0/3330652843 >> 172.21.15.5:0/3330652843 conn(0x7fcce40fc270 msgr2=0x7fcce40fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:10.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.407+0000 7fcce9e00700 1 -- 172.21.15.5:0/3330652843 shutdown_connections 2024-01-24T15:40:10.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.407+0000 7fcce9e00700 1 -- 172.21.15.5:0/3330652843 wait complete. 2024-01-24T15:40:10.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.409+0000 7fcce9e00700 1 Processor -- start 2024-01-24T15:40:10.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.409+0000 7fcce9e00700 1 -- start start 2024-01-24T15:40:10.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.409+0000 7fcce9e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcce4100d40 0x7fcce4196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:10.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.409+0000 7fcce9e00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce4101f30 0x7fcce4196ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:10.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.409+0000 7fcce9e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcce41028d0 0x7fcce419df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:10.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.410+0000 7fcce9e00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce419e510 con 0x7fcce41028d0 2024-01-24T15:40:10.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.410+0000 7fcce9e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce419e650 con 0x7fcce4100d40 2024-01-24T15:40:10.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.410+0000 7fcce9e00700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce419e7e0 con 0x7fcce4101f30 2024-01-24T15:40:10.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.410+0000 7fcce3400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcce41028d0 0x7fcce419df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:10.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.410+0000 7fcce2a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcce4100d40 0x7fcce4196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:10.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.410+0000 7fcce2a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcce4100d40 0x7fcce4196990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.5:38328/0 (socket says 172.21.15.5:38328) 2024-01-24T15:40:10.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.410+0000 7fcce2a00700 1 -- 172.21.15.5:0/2669665505 learned_addr learned my addr 172.21.15.5:0/2669665505 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:40:10.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.410+0000 7fcce2000700 1 --2- 172.21.15.5:0/2669665505 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce4101f30 0x7fcce4196ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:10.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.410+0000 7fcce3400700 1 -- 172.21.15.5:0/2669665505 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce4101f30 msgr2=0x7fcce4196ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:10.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.410+0000 7fcce3400700 1 --2- 172.21.15.5:0/2669665505 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce4101f30 0x7fcce4196ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:10.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.410+0000 7fcce3400700 1 -- 172.21.15.5:0/2669665505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcce4100d40 msgr2=0x7fcce4196990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:10.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.410+0000 7fcce3400700 1 --2- 172.21.15.5:0/2669665505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcce4100d40 0x7fcce4196990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:10.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.410+0000 7fcce3400700 1 -- 172.21.15.5:0/2669665505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd40095f0 con 0x7fcce41028d0 2024-01-24T15:40:10.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.410+0000 7fcce3400700 1 --2- 172.21.15.5:0/2669665505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcce41028d0 0x7fcce419df40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fccdc007f10 tx=0x7fccdc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:10.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.411+0000 7fcce8a00700 1 -- 172.21.15.5:0/2669665505 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc009ea0 con 0x7fcce41028d0 2024-01-24T15:40:10.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.411+0000 7fcce8a00700 1 -- 172.21.15.5:0/2669665505 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fccdc00f040 con 0x7fcce41028d0 2024-01-24T15:40:10.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.411+0000 7fcce9e00700 1 -- 172.21.15.5:0/2669665505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce419eac0 con 0x7fcce41028d0 2024-01-24T15:40:10.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.411+0000 7fcce8a00700 1 -- 172.21.15.5:0/2669665505 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc004280 con 0x7fcce41028d0 2024-01-24T15:40:10.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.411+0000 7fcce9e00700 1 -- 172.21.15.5:0/2669665505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce419efd0 con 0x7fcce41028d0 2024-01-24T15:40:10.416 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.412+0000 7fcce9e00700 1 -- 172.21.15.5:0/2669665505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce41083d0 con 0x7fcce41028d0 2024-01-24T15:40:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.414+0000 7fcce8a00700 1 -- 172.21.15.5:0/2669665505 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7fccdc00db20 con 0x7fcce41028d0 2024-01-24T15:40:10.417 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.415+0000 7fcce8a00700 1 --2- 172.21.15.5:0/2669665505 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fccc40a05f0 0x7fccc40a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:10.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.415+0000 7fcce8a00700 1 -- 172.21.15.5:0/2669665505 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fccdc0cae20 con 0x7fcce41028d0 2024-01-24T15:40:10.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.415+0000 7fcce2a00700 1 --2- 172.21.15.5:0/2669665505 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fccc40a05f0 0x7fccc40a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:10.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.416+0000 7fcce2a00700 1 --2- 172.21.15.5:0/2669665505 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fccc40a05f0 0x7fccc40a2ab0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fccd40095c0 tx=0x7fccd4009530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:10.421 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.419+0000 7fcce8a00700 1 -- 172.21.15.5:0/2669665505 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7fccdc094dc0 con 0x7fcce41028d0 2024-01-24T15:40:10.507 INFO:journalctl@ceph.mds.b.smithi160.stdout:Jan 24 15:40:10 smithi160 systemd[1]: Starting Ceph mds.b for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:40:10.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.681+0000 7fcce9e00700 1 -- 172.21.15.5:0/2669665505 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcce402d100 con 0x7fcce41028d0 2024-01-24T15:40:10.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.681+0000 7fcce8a00700 1 -- 172.21.15.5:0/2669665505 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8837 (secure 0 0 0) 0x7fccdc0983e0 con 0x7fcce41028d0 2024-01-24T15:40:10.684 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:40:10.684 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14625,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/349535608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":349535608},{"type":"v1","addr":"172.21.15.160:6835","nonce":349535608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/3768781825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3768781825},{"type":"v1","addr":"172.21.15.5:6841","nonce":3768781825}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3072071447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3072071447},{"type":"v1","addr":"172.21.15.160:6833","nonce":3072071447}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/3525889833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3525889833},{"type":"v1","addr":"172.21.15.204:6833","nonce":3525889833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2310427373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2310427373},{"type":"v1","addr":"172.21.15.5:6835","nonce":2310427373}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2985908642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2985908642},{"type":"v1","addr":"172.21.15.5:6837","nonce":2985908642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24515,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/1401493351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1401493351},{"type":"v1","addr":"172.21.15.204:6835","nonce":1401493351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2022828845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2022828845},{"type":"v1","addr":"172.21.15.160:6837","nonce":2022828845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24541,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/2142560585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6836","nonce":2142560585},{"type":"v1","addr":"172.21.15.204:6837","nonce":2142560585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24562,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6839/3704737145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6838","nonce":3704737145},{"type":"v1","addr":"172.21.15.204:6839","nonce":3704737145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24563,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/1626257631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":1626257631},{"type":"v1","addr":"172.21.15.5:6839","nonce":1626257631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[]} 2024-01-24T15:40:10.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.684+0000 7fcce9e00700 1 -- 172.21.15.5:0/2669665505 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fccc40a05f0 msgr2=0x7fccc40a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:10.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.684+0000 7fcce9e00700 1 --2- 172.21.15.5:0/2669665505 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fccc40a05f0 0x7fccc40a2ab0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fccd40095c0 tx=0x7fccd4009530 comp rx=0 tx=0).stop 2024-01-24T15:40:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.684+0000 7fcce9e00700 1 -- 172.21.15.5:0/2669665505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcce41028d0 msgr2=0x7fcce419df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.684+0000 7fcce9e00700 1 --2- 172.21.15.5:0/2669665505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcce41028d0 0x7fcce419df40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fccdc007f10 tx=0x7fccdc00d3b0 comp rx=0 tx=0).stop 2024-01-24T15:40:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.684+0000 7fcce9e00700 1 -- 172.21.15.5:0/2669665505 shutdown_connections 2024-01-24T15:40:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.684+0000 7fcce9e00700 1 --2- 172.21.15.5:0/2669665505 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fccc40a05f0 0x7fccc40a2ab0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.684+0000 7fcce9e00700 1 --2- 172.21.15.5:0/2669665505 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcce41028d0 0x7fcce419df40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.684+0000 7fcce9e00700 1 --2- 172.21.15.5:0/2669665505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcce4100d40 0x7fcce4196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.684+0000 7fcce9e00700 1 --2- 172.21.15.5:0/2669665505 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce4101f30 0x7fcce4196ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.684+0000 7fcce9e00700 1 -- 172.21.15.5:0/2669665505 >> 172.21.15.5:0/2669665505 conn(0x7fcce40fc270 msgr2=0x7fcce4105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.684+0000 7fcce9e00700 1 -- 172.21.15.5:0/2669665505 shutdown_connections 2024-01-24T15:40:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:10.684+0000 7fcce9e00700 1 -- 172.21.15.5:0/2669665505 wait complete. 2024-01-24T15:40:10.687 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 12 2024-01-24T15:40:10.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:10 smithi005 ceph-mon[35346]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:10.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:10 smithi204 ceph-mon[39634]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:11.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:10 smithi160 ceph-mon[38982]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:11.007 INFO:journalctl@ceph.mds.b.smithi160.stdout:Jan 24 15:40:10 smithi160 bash[75165]: 35b733cee7e68d15351b861627e99d221e25ca6f222ad644e0ccbf2782befc4f 2024-01-24T15:40:11.007 INFO:journalctl@ceph.mds.b.smithi160.stdout:Jan 24 15:40:10 smithi160 systemd[1]: Started Ceph mds.b for bede0bb6-bacd-11ee-95b1-87774f69a715. 2024-01-24T15:40:11.007 INFO:journalctl@ceph.mds.b.smithi160.stdout:Jan 24 15:40:10 smithi160 ceph-mds[75203]: -- 172.21.15.160:0/959872914 <== mon.2 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ffc703b1e0 con 0x55ffc7013000 2024-01-24T15:40:11.007 INFO:journalctl@ceph.mds.b.smithi160.stdout:Jan 24 15:40:10 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-b[75180]: starting mds.b at 2024-01-24T15:40:11.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:11 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/2669665505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:40:11.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:11.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:11.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:11.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:11.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:11.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:11 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:40:11.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:11 smithi005 ceph-mon[35346]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:11.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:11 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/2669665505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:40:11.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:11 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:11.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:11 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:11.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:11 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:11.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:11 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:11.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:11 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:11.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:11 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:40:11.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:11 smithi204 ceph-mon[39634]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:12.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:11 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/2669665505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:40:12.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:11 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:12.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:11 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:12.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:11 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:12.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:11 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:12.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:11 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:12.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:11 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:40:12.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:11 smithi160 ceph-mon[38982]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:12.706 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-24T15:40:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.925+0000 7f6911a00700 1 -- 172.21.15.5:0/4138835822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f690c1017a0 msgr2=0x7f690c103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.925+0000 7f6911a00700 1 --2- 172.21.15.5:0/4138835822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f690c1017a0 0x7f690c103b90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f68fc009990 tx=0x7f68fc009ca0 comp rx=0 tx=0).stop 2024-01-24T15:40:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.925+0000 7f6911a00700 1 -- 172.21.15.5:0/4138835822 shutdown_connections 2024-01-24T15:40:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.925+0000 7f6911a00700 1 --2- 172.21.15.5:0/4138835822 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f690c106a00 0x7f690c108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.925+0000 7f6911a00700 1 --2- 172.21.15.5:0/4138835822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f690c1017a0 0x7f690c103b90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:12.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.925+0000 7f6911a00700 1 --2- 172.21.15.5:0/4138835822 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f690c1040d0 0x7f690c1064c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.926+0000 7f6911a00700 1 -- 172.21.15.5:0/4138835822 >> 172.21.15.5:0/4138835822 conn(0x7f690c0fb170 msgr2=0x7f690c0fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.926+0000 7f6911a00700 1 -- 172.21.15.5:0/4138835822 shutdown_connections 2024-01-24T15:40:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.926+0000 7f6911a00700 1 -- 172.21.15.5:0/4138835822 wait complete. 2024-01-24T15:40:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.927+0000 7f6911a00700 1 Processor -- start 2024-01-24T15:40:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.927+0000 7f6911a00700 1 -- start start 2024-01-24T15:40:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.927+0000 7f6911a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f690c1017a0 0x7f690c1968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.927+0000 7f6911a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f690c1040d0 0x7f690c196de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:12.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.927+0000 7f6911a00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f690c106a00 0x7f690c19de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.927+0000 7f6911a00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c19e420 con 0x7f690c1017a0 2024-01-24T15:40:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.927+0000 7f6911a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c19e560 con 0x7f690c1040d0 2024-01-24T15:40:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.927+0000 7f6911a00700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c19e6f0 con 0x7f690c106a00 2024-01-24T15:40:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.928+0000 7f690a000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f690c1040d0 0x7f690c196de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.928+0000 7f690a000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f690c1040d0 0x7f690c196de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.5:39322/0 (socket says 172.21.15.5:39322) 2024-01-24T15:40:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.928+0000 7f690a000700 1 -- 172.21.15.5:0/3757693984 learned_addr learned my addr 172.21.15.5:0/3757693984 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:40:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.928+0000 7f690b400700 1 --2- 172.21.15.5:0/3757693984 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f690c106a00 0x7f690c19de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.928+0000 7f690aa00700 1 --2- 172.21.15.5:0/3757693984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f690c1017a0 0x7f690c1968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.928+0000 7f690a000700 1 -- 172.21.15.5:0/3757693984 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f690c106a00 msgr2=0x7f690c19de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.928+0000 7f690a000700 1 --2- 172.21.15.5:0/3757693984 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f690c106a00 0x7f690c19de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.928+0000 7f690a000700 1 -- 172.21.15.5:0/3757693984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f690c1017a0 msgr2=0x7f690c1968a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.928+0000 7f690a000700 1 --2- 172.21.15.5:0/3757693984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f690c1017a0 0x7f690c1968a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.928+0000 7f690a000700 1 -- 172.21.15.5:0/3757693984 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc0095f0 con 0x7f690c1040d0 2024-01-24T15:40:12.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.928+0000 7f690a000700 1 --2- 172.21.15.5:0/3757693984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f690c1040d0 0x7f690c196de0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f68f400d980 tx=0x7f68f400dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.929+0000 7f6903400700 1 -- 172.21.15.5:0/3757693984 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4004220 con 0x7f690c1040d0 2024-01-24T15:40:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.929+0000 7f6903400700 1 -- 172.21.15.5:0/3757693984 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f68f4007640 con 0x7f690c1040d0 2024-01-24T15:40:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.929+0000 7f6911a00700 1 -- 172.21.15.5:0/3757693984 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f690c19e9d0 con 0x7f690c1040d0 2024-01-24T15:40:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.929+0000 7f6903400700 1 -- 172.21.15.5:0/3757693984 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4005660 con 0x7f690c1040d0 2024-01-24T15:40:12.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.929+0000 7f6911a00700 1 -- 172.21.15.5:0/3757693984 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690c19ef30 con 0x7f690c1040d0 2024-01-24T15:40:12.937 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:12 smithi005 ceph-mon[35346]: mds.? [v2:172.21.15.160:6838/3540787202,v1:172.21.15.160:6839/3540787202] up:boot 2024-01-24T15:40:12.937 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:12 smithi005 ceph-mon[35346]: fsmap 12 up:standby 2024-01-24T15:40:12.937 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:12 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-24T15:40:12.937 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:12 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:12.938 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:12 smithi160 ceph-mon[38982]: mds.? [v2:172.21.15.160:6838/3540787202,v1:172.21.15.160:6839/3540787202] up:boot 2024-01-24T15:40:12.938 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:12 smithi160 ceph-mon[38982]: fsmap 12 up:standby 2024-01-24T15:40:12.938 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:12 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-24T15:40:12.938 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:12 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.930+0000 7f6911a00700 1 -- 172.21.15.5:0/3757693984 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f690c0fccf0 con 0x7f690c1040d0 2024-01-24T15:40:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.932+0000 7f6903400700 1 -- 172.21.15.5:0/3757693984 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f68f4004750 con 0x7f690c1040d0 2024-01-24T15:40:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.933+0000 7f6903400700 1 --2- 172.21.15.5:0/3757693984 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f68ec0a05f0 0x7f68ec0a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.933+0000 7f6903400700 1 -- 172.21.15.5:0/3757693984 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f68f40cb2e0 con 0x7f690c1040d0 2024-01-24T15:40:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.933+0000 7f690aa00700 1 --2- 172.21.15.5:0/3757693984 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f68ec0a05f0 0x7f68ec0a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:12.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.934+0000 7f690aa00700 1 --2- 172.21.15.5:0/3757693984 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f68ec0a05f0 0x7f68ec0a2ab0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f68fc006010 tx=0x7f68fc005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:12.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:12.938+0000 7f6903400700 1 -- 172.21.15.5:0/3757693984 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f68f4095280 con 0x7f690c1040d0 2024-01-24T15:40:12.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:12 smithi204 ceph-mon[39634]: mds.? [v2:172.21.15.160:6838/3540787202,v1:172.21.15.160:6839/3540787202] up:boot 2024-01-24T15:40:12.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:12 smithi204 ceph-mon[39634]: fsmap 12 up:standby 2024-01-24T15:40:12.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:12 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-24T15:40:12.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:12 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:13.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.202+0000 7f6911a00700 1 -- 172.21.15.5:0/3757693984 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f690c02cc70 con 0x7f690c1040d0 2024-01-24T15:40:13.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.203+0000 7f6903400700 1 -- 172.21.15.5:0/3757693984 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9598 (secure 0 0 0) 0x7f68f40988a0 con 0x7f690c1040d0 2024-01-24T15:40:13.206 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:40:13.206 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14625,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/349535608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":349535608},{"type":"v1","addr":"172.21.15.160:6835","nonce":349535608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":14688,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/3768781825","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":3768781825},{"type":"v1","addr":"172.21.15.5:6841","nonce":3768781825}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3072071447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3072071447},{"type":"v1","addr":"172.21.15.160:6833","nonce":3072071447}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24472,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6833/3525889833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6832","nonce":3525889833},{"type":"v1","addr":"172.21.15.204:6833","nonce":3525889833}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24479,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/2310427373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":2310427373},{"type":"v1","addr":"172.21.15.5:6835","nonce":2310427373}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24491,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2985908642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2985908642},{"type":"v1","addr":"172.21.15.5:6837","nonce":2985908642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24515,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6835/1401493351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6834","nonce":1401493351},{"type":"v1","addr":"172.21.15.204:6835","nonce":1401493351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24539,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2022828845","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":2022828845},{"type":"v1","addr":"172.21.15.160:6837","nonce":2022828845}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24541,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6837/2142560585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6836","nonce":2142560585},{"type":"v1","addr":"172.21.15.204:6837","nonce":2142560585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24562,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.204:6839/3704737145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6838","nonce":3704737145},{"type":"v1","addr":"172.21.15.204:6839","nonce":3704737145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24563,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/1626257631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":1626257631},{"type":"v1","addr":"172.21.15.5:6839","nonce":1626257631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24587,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/3540787202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":3540787202},{"type":"v1","addr":"172.21.15.160:6839","nonce":3540787202}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2024-01-24T15:40:13.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.205+0000 7f6911a00700 1 -- 172.21.15.5:0/3757693984 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f68ec0a05f0 msgr2=0x7f68ec0a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:13.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.205+0000 7f6911a00700 1 --2- 172.21.15.5:0/3757693984 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f68ec0a05f0 0x7f68ec0a2ab0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f68fc006010 tx=0x7f68fc005960 comp rx=0 tx=0).stop 2024-01-24T15:40:13.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.206+0000 7f6911a00700 1 -- 172.21.15.5:0/3757693984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f690c1040d0 msgr2=0x7f690c196de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:13.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.206+0000 7f6911a00700 1 --2- 172.21.15.5:0/3757693984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f690c1040d0 0x7f690c196de0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f68f400d980 tx=0x7f68f400dc90 comp rx=0 tx=0).stop 2024-01-24T15:40:13.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.206+0000 7f6911a00700 1 -- 172.21.15.5:0/3757693984 shutdown_connections 2024-01-24T15:40:13.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.206+0000 7f6911a00700 1 --2- 172.21.15.5:0/3757693984 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f690c106a00 0x7f690c19de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:13.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.206+0000 7f6911a00700 1 --2- 172.21.15.5:0/3757693984 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f68ec0a05f0 0x7f68ec0a2ab0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:13.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.206+0000 7f6911a00700 1 --2- 172.21.15.5:0/3757693984 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f690c1017a0 0x7f690c1968a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:13.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.206+0000 7f6911a00700 1 --2- 172.21.15.5:0/3757693984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f690c1040d0 0x7f690c196de0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:13.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.206+0000 7f6911a00700 1 -- 172.21.15.5:0/3757693984 >> 172.21.15.5:0/3757693984 conn(0x7f690c0fb170 msgr2=0x7f690c102410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:13.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.206+0000 7f6911a00700 1 -- 172.21.15.5:0/3757693984 shutdown_connections 2024-01-24T15:40:13.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.206+0000 7f6911a00700 1 -- 172.21.15.5:0/3757693984 wait complete. 2024-01-24T15:40:13.209 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 13 2024-01-24T15:40:13.228 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T15:40:13.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.425+0000 7f5ede800700 1 -- 172.21.15.5:0/805045994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed81028d0 msgr2=0x7f5ed8109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.425+0000 7f5ede800700 1 --2- 172.21.15.5:0/805045994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed81028d0 0x7f5ed8109180 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000b0d0 tx=0x7f5ed000b3e0 comp rx=0 tx=0).stop 2024-01-24T15:40:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.426+0000 7f5ede800700 1 -- 172.21.15.5:0/805045994 shutdown_connections 2024-01-24T15:40:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.426+0000 7f5ede800700 1 --2- 172.21.15.5:0/805045994 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed81028d0 0x7f5ed8109180 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.426+0000 7f5ede800700 1 --2- 172.21.15.5:0/805045994 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ed8100d40 0x7f5ed8101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.426+0000 7f5ede800700 1 --2- 172.21.15.5:0/805045994 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ed8101f30 0x7f5ed8102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.426+0000 7f5ede800700 1 -- 172.21.15.5:0/805045994 >> 172.21.15.5:0/805045994 conn(0x7f5ed80fc270 msgr2=0x7f5ed80fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.426+0000 7f5ede800700 1 -- 172.21.15.5:0/805045994 shutdown_connections 2024-01-24T15:40:13.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.426+0000 7f5ede800700 1 -- 172.21.15.5:0/805045994 wait complete. 2024-01-24T15:40:13.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.427+0000 7f5ede800700 1 Processor -- start 2024-01-24T15:40:13.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.427+0000 7f5ede800700 1 -- start start 2024-01-24T15:40:13.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.427+0000 7f5ede800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed8100d40 0x7f5ed8198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.427+0000 7f5ede800700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ed8101f30 0x7f5ed8199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.427+0000 7f5ede800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ed81028d0 0x7f5ed81a0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.427+0000 7f5ede800700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed81a0750 con 0x7f5ed8100d40 2024-01-24T15:40:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.427+0000 7f5ede800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed81a0890 con 0x7f5ed81028d0 2024-01-24T15:40:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.427+0000 7f5ede800700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed81a0a20 con 0x7f5ed8101f30 2024-01-24T15:40:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.427+0000 7f5ed7400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed8100d40 0x7f5ed8198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.427+0000 7f5ed7400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed8100d40 0x7f5ed8198bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50232/0 (socket says 172.21.15.5:50232) 2024-01-24T15:40:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.427+0000 7f5ed7400700 1 -- 172.21.15.5:0/4048954546 learned_addr learned my addr 172.21.15.5:0/4048954546 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:40:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.427+0000 7f5ed7e00700 1 --2- 172.21.15.5:0/4048954546 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ed81028d0 0x7f5ed81a0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:13.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.427+0000 7f5ed6a00700 1 --2- 172.21.15.5:0/4048954546 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ed8101f30 0x7f5ed8199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.428+0000 7f5ed7400700 1 -- 172.21.15.5:0/4048954546 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ed8101f30 msgr2=0x7f5ed8199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.428+0000 7f5ed7400700 1 --2- 172.21.15.5:0/4048954546 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ed8101f30 0x7f5ed8199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.428+0000 7f5ed7400700 1 -- 172.21.15.5:0/4048954546 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ed81028d0 msgr2=0x7f5ed81a0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.428+0000 7f5ed7400700 1 --2- 172.21.15.5:0/4048954546 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ed81028d0 0x7f5ed81a0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.428+0000 7f5ed7400700 1 -- 172.21.15.5:0/4048954546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed0009d00 con 0x7f5ed8100d40 2024-01-24T15:40:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.428+0000 7f5ed7400700 1 --2- 172.21.15.5:0/4048954546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed8100d40 0x7f5ed8198bd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5ec800e970 tx=0x7f5ec800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.428+0000 7f5ecfe00700 1 -- 172.21.15.5:0/4048954546 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8009790 con 0x7f5ed8100d40 2024-01-24T15:40:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.428+0000 7f5ecfe00700 1 -- 172.21.15.5:0/4048954546 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ec800c7e0 con 0x7f5ed8100d40 2024-01-24T15:40:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.428+0000 7f5ede800700 1 -- 172.21.15.5:0/4048954546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed81a0d00 con 0x7f5ed8100d40 2024-01-24T15:40:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.428+0000 7f5ecfe00700 1 -- 172.21.15.5:0/4048954546 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8003bd0 con 0x7f5ed8100d40 2024-01-24T15:40:13.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.428+0000 7f5ede800700 1 -- 172.21.15.5:0/4048954546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed81a11b0 con 0x7f5ed8100d40 2024-01-24T15:40:13.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.429+0000 7f5ede800700 1 -- 172.21.15.5:0/4048954546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed810c480 con 0x7f5ed8100d40 2024-01-24T15:40:13.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.433+0000 7f5ecfe00700 1 -- 172.21.15.5:0/4048954546 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f5ec800c950 con 0x7f5ed8100d40 2024-01-24T15:40:13.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.434+0000 7f5ecfe00700 1 --2- 172.21.15.5:0/4048954546 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5eb80a05f0 0x7f5eb80a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:13.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.434+0000 7f5ecfe00700 1 -- 172.21.15.5:0/4048954546 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5ec8014070 con 0x7f5ed8100d40 2024-01-24T15:40:13.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.434+0000 7f5ed6a00700 1 --2- 172.21.15.5:0/4048954546 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5eb80a05f0 0x7f5eb80a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:13.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.435+0000 7f5ed6a00700 1 --2- 172.21.15.5:0/4048954546 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5eb80a05f0 0x7f5eb80a2ab0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0009c60 tx=0x7f5ec0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.437+0000 7f5ecfe00700 1 -- 172.21.15.5:0/4048954546 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f5ec80957c0 con 0x7f5ed8100d40 2024-01-24T15:40:13.655 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.652+0000 7f5ede800700 1 -- 172.21.15.5:0/4048954546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ed810c670 con 0x7f5ed8100d40 2024-01-24T15:40:13.656 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.654+0000 7f5ecfe00700 1 -- 172.21.15.5:0/4048954546 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+18376 (secure 0 0 0) 0x7f5ec8098de0 con 0x7f5ed8100d40 2024-01-24T15:40:13.657 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:40:13.657 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":78,"fsid":"bede0bb6-bacd-11ee-95b1-87774f69a715","created":"2024-01-24T15:33:13.568798+0000","modified":"2024-01-24T15:39:32.604313+0000","last_up_change":"2024-01-24T15:39:31.302244+0000","last_in_change":"2024-01-24T15:39:11.995261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T15:36:17.760558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"caab3496-5d11-4c8e-bd4f-ca7cdb6924a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3395335330},{"type":"v1","addr":"172.21.15.5:6803","nonce":3395335330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3395335330},{"type":"v1","addr":"172.21.15.5:6805","nonce":3395335330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3395335330},{"type":"v1","addr":"172.21.15.5:6809","nonce":3395335330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3395335330},{"type":"v1","addr":"172.21.15.5:6807","nonce":3395335330}]},"public_addr":"172.21.15.5:6803/3395335330","cluster_addr":"172.21.15.5:6805/3395335330","heartbeat_back_addr":"172.21.15.5:6809/3395335330","heartbeat_front_addr":"172.21.15.5:6807/3395335330","state":["exists","up"]},{"osd":1,"uuid":"547ee262-816e-46ee-b4d4-8dd267abb2de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1386884060},{"type":"v1","addr":"172.21.15.160:6801","nonce":1386884060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1386884060},{"type":"v1","addr":"172.21.15.160:6803","nonce":1386884060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1386884060},{"type":"v1","addr":"172.21.15.160:6807","nonce":1386884060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1386884060},{"type":"v1","addr":"172.21.15.160:6805","nonce":1386884060}]},"public_addr":"172.21.15.160:6801/1386884060","cluster_addr":"172.21.15.160:6803/1386884060","heartbeat_back_addr":"172.21.15.160:6807/1386884060","heartbeat_front_addr":"172.21.15.160:6805/1386884060","state":["exists","up"]},{"osd":2,"uuid":"b07d96ff-9584-4e71-a846-e8b939918708","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1780238382},{"type":"v1","addr":"172.21.15.204:6801","nonce":1780238382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1780238382},{"type":"v1","addr":"172.21.15.204:6803","nonce":1780238382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1780238382},{"type":"v1","addr":"172.21.15.204:6807","nonce":1780238382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1780238382},{"type":"v1","addr":"172.21.15.204:6805","nonce":1780238382}]},"public_addr":"172.21.15.204:6801/1780238382","cluster_addr":"172.21.15.204:6803/1780238382","heartbeat_back_addr":"172.21.15.204:6807/1780238382","heartbeat_front_addr":"172.21.15.204:6805/1780238382","state":["exists","up"]},{"osd":3,"uuid":"4a086309-5d6b-4226-93d0-e3e55ced7172","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2647874051},{"type":"v1","addr":"172.21.15.5:6811","nonce":2647874051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2647874051},{"type":"v1","addr":"172.21.15.5:6813","nonce":2647874051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2647874051},{"type":"v1","addr":"172.21.15.5:6817","nonce":2647874051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2647874051},{"type":"v1","addr":"172.21.15.5:6815","nonce":2647874051}]},"public_addr":"172.21.15.5:6811/2647874051","cluster_addr":"172.21.15.5:6813/2647874051","heartbeat_back_addr":"172.21.15.5:6817/2647874051","heartbeat_front_addr":"172.21.15.5:6815/2647874051","state":["exists","up"]},{"osd":4,"uuid":"27d27d11-ef97-4faf-b5fb-c744bbdbcf9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4260815326},{"type":"v1","addr":"172.21.15.160:6809","nonce":4260815326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4260815326},{"type":"v1","addr":"172.21.15.160:6811","nonce":4260815326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4260815326},{"type":"v1","addr":"172.21.15.160:6815","nonce":4260815326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4260815326},{"type":"v1","addr":"172.21.15.160:6813","nonce":4260815326}]},"public_addr":"172.21.15.160:6809/4260815326","cluster_addr":"172.21.15.160:6811/4260815326","heartbeat_back_addr":"172.21.15.160:6815/4260815326","heartbeat_front_addr":"172.21.15.160:6813/4260815326","state":["exists","up"]},{"osd":5,"uuid":"12425c52-d7ae-46f9-a949-c089587b3ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":1024339043},{"type":"v1","addr":"172.21.15.204:6809","nonce":1024339043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":1024339043},{"type":"v1","addr":"172.21.15.204:6811","nonce":1024339043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":1024339043},{"type":"v1","addr":"172.21.15.204:6815","nonce":1024339043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":1024339043},{"type":"v1","addr":"172.21.15.204:6813","nonce":1024339043}]},"public_addr":"172.21.15.204:6809/1024339043","cluster_addr":"172.21.15.204:6811/1024339043","heartbeat_back_addr":"172.21.15.204:6815/1024339043","heartbeat_front_addr":"172.21.15.204:6813/1024339043","state":["exists","up"]},{"osd":6,"uuid":"2dda7ced-0f36-4f9e-aa2c-3d2d03990ed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":754402627},{"type":"v1","addr":"172.21.15.5:6819","nonce":754402627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":754402627},{"type":"v1","addr":"172.21.15.5:6821","nonce":754402627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":754402627},{"type":"v1","addr":"172.21.15.5:6825","nonce":754402627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":754402627},{"type":"v1","addr":"172.21.15.5:6823","nonce":754402627}]},"public_addr":"172.21.15.5:6819/754402627","cluster_addr":"172.21.15.5:6821/754402627","heartbeat_back_addr":"172.21.15.5:6825/754402627","heartbeat_front_addr":"172.21.15.5:6823/754402627","state":["exists","up"]},{"osd":7,"uuid":"cafcc179-ee88-44b5-a3b0-e8d772bf8ac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":369148145},{"type":"v1","addr":"172.21.15.160:6817","nonce":369148145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":369148145},{"type":"v1","addr":"172.21.15.160:6819","nonce":369148145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":369148145},{"type":"v1","addr":"172.21.15.160:6823","nonce":369148145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":369148145},{"type":"v1","addr":"172.21.15.160:6821","nonce":369148145}]},"public_addr":"172.21.15.160:6817/369148145","cluster_addr":"172.21.15.160:6819/369148145","heartbeat_back_addr":"172.21.15.160:6823/369148145","heartbeat_front_addr":"172.21.15.160:6821/369148145","state":["exists","up"]},{"osd":8,"uuid":"02951778-7bd2-4628-a9e2-4029d1d94fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1351316997},{"type":"v1","addr":"172.21.15.204:6817","nonce":1351316997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":1351316997},{"type":"v1","addr":"172.21.15.204:6819","nonce":1351316997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":1351316997},{"type":"v1","addr":"172.21.15.204:6823","nonce":1351316997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":1351316997},{"type":"v1","addr":"172.21.15.204:6821","nonce":1351316997}]},"public_addr":"172.21.15.204:6817/1351316997","cluster_addr":"172.21.15.204:6819/1351316997","heartbeat_back_addr":"172.21.15.204:6823/1351316997","heartbeat_front_addr":"172.21.15.204:6821/1351316997","state":["exists","up"]},{"osd":9,"uuid":"ae93d215-dc45-4916-a42d-72d7da51260c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2119772860},{"type":"v1","addr":"172.21.15.5:6827","nonce":2119772860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2119772860},{"type":"v1","addr":"172.21.15.5:6829","nonce":2119772860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2119772860},{"type":"v1","addr":"172.21.15.5:6833","nonce":2119772860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2119772860},{"type":"v1","addr":"172.21.15.5:6831","nonce":2119772860}]},"public_addr":"172.21.15.5:6827/2119772860","cluster_addr":"172.21.15.5:6829/2119772860","heartbeat_back_addr":"172.21.15.5:6833/2119772860","heartbeat_front_addr":"172.21.15.5:6831/2119772860","state":["exists","up"]},{"osd":10,"uuid":"6c22bfc5-3d41-491a-b862-18ef48485d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4035458661},{"type":"v1","addr":"172.21.15.160:6825","nonce":4035458661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":4035458661},{"type":"v1","addr":"172.21.15.160:6827","nonce":4035458661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":4035458661},{"type":"v1","addr":"172.21.15.160:6831","nonce":4035458661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":4035458661},{"type":"v1","addr":"172.21.15.160:6829","nonce":4035458661}]},"public_addr":"172.21.15.160:6825/4035458661","cluster_addr":"172.21.15.160:6827/4035458661","heartbeat_back_addr":"172.21.15.160:6831/4035458661","heartbeat_front_addr":"172.21.15.160:6829/4035458661","state":["exists","up"]},{"osd":11,"uuid":"f7b11c08-6aaa-4c9c-bf3e-794e0ed6a48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":1270764757},{"type":"v1","addr":"172.21.15.204:6825","nonce":1270764757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":1270764757},{"type":"v1","addr":"172.21.15.204:6827","nonce":1270764757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":1270764757},{"type":"v1","addr":"172.21.15.204:6831","nonce":1270764757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":1270764757},{"type":"v1","addr":"172.21.15.204:6829","nonce":1270764757}]},"public_addr":"172.21.15.204:6825/1270764757","cluster_addr":"172.21.15.204:6827/1270764757","heartbeat_back_addr":"172.21.15.204:6831/1270764757","heartbeat_front_addr":"172.21.15.204:6829/1270764757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:35:30.487540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:35:51.102011+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:36:13.732852+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:36:35.091981+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:36:55.969859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:37:19.104930+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:37:40.814117+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:38:01.341317+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:38:24.655220+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:38:46.055116+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:39:06.708244+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:39:29.705438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/2286807214":"2024-01-25T15:34:07.143709+0000","172.21.15.5:0/335989886":"2024-01-25T15:34:07.143709+0000","172.21.15.5:0/3245435659":"2024-01-25T15:33:43.447232+0000","172.21.15.5:6800/1174207089":"2024-01-25T15:33:43.447232+0000","172.21.15.5:6800/2286807214":"2024-01-25T15:34:07.143709+0000","172.21.15.5:0/1119155546":"2024-01-25T15:34:07.143709+0000","172.21.15.5:0/1582462061":"2024-01-25T15:33:43.447232+0000","172.21.15.5:0/815108608":"2024-01-25T15:33:43.447232+0000","172.21.15.5:6801/1174207089":"2024-01-25T15:33:43.447232+0000","172.21.15.5:0/3735059725":"2024-01-25T15:34:07.143709+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T15:40:13.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.656+0000 7f5ede800700 1 -- 172.21.15.5:0/4048954546 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5eb80a05f0 msgr2=0x7f5eb80a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:13.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.656+0000 7f5ede800700 1 --2- 172.21.15.5:0/4048954546 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5eb80a05f0 0x7f5eb80a2ab0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0009c60 tx=0x7f5ec0009260 comp rx=0 tx=0).stop 2024-01-24T15:40:13.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.656+0000 7f5ede800700 1 -- 172.21.15.5:0/4048954546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed8100d40 msgr2=0x7f5ed8198bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:13.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.656+0000 7f5ede800700 1 --2- 172.21.15.5:0/4048954546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed8100d40 0x7f5ed8198bd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5ec800e970 tx=0x7f5ec800ec80 comp rx=0 tx=0).stop 2024-01-24T15:40:13.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.656+0000 7f5ede800700 1 -- 172.21.15.5:0/4048954546 shutdown_connections 2024-01-24T15:40:13.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.656+0000 7f5ede800700 1 --2- 172.21.15.5:0/4048954546 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ed81028d0 0x7f5ed81a0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:13.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.656+0000 7f5ede800700 1 --2- 172.21.15.5:0/4048954546 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5eb80a05f0 0x7f5eb80a2ab0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:13.659 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.656+0000 7f5ede800700 1 --2- 172.21.15.5:0/4048954546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5ed8100d40 0x7f5ed8198bd0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:13.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.656+0000 7f5ede800700 1 --2- 172.21.15.5:0/4048954546 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5ed8101f30 0x7f5ed8199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:13.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.656+0000 7f5ede800700 1 -- 172.21.15.5:0/4048954546 >> 172.21.15.5:0/4048954546 conn(0x7f5ed80fc270 msgr2=0x7f5ed80fe490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:13.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.657+0000 7f5ede800700 1 -- 172.21.15.5:0/4048954546 shutdown_connections 2024-01-24T15:40:13.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.657+0000 7f5ede800700 1 -- 172.21.15.5:0/4048954546 wait complete. 2024-01-24T15:40:13.679 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-24T15:36:17.760558+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-24T15:40:13.679 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-24T15:40:13.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.880+0000 7fb480a00700 1 -- 172.21.15.5:0/2950439553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb478101f20 msgr2=0x7fb478102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:13.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.880+0000 7fb480a00700 1 --2- 172.21.15.5:0/2950439553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb478101f20 0x7fb478102380 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb4600099c0 tx=0x7fb460009cd0 comp rx=0 tx=0).stop 2024-01-24T15:40:13.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.881+0000 7fb480a00700 1 -- 172.21.15.5:0/2950439553 shutdown_connections 2024-01-24T15:40:13.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.881+0000 7fb480a00700 1 --2- 172.21.15.5:0/2950439553 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4781028c0 0x7fb478109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:13.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.881+0000 7fb480a00700 1 --2- 172.21.15.5:0/2950439553 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb478100d30 0x7fb478101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:13.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.881+0000 7fb480a00700 1 --2- 172.21.15.5:0/2950439553 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb478101f20 0x7fb478102380 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:13.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.881+0000 7fb480a00700 1 -- 172.21.15.5:0/2950439553 >> 172.21.15.5:0/2950439553 conn(0x7fb4780fc280 msgr2=0x7fb4780fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:13.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.881+0000 7fb480a00700 1 -- 172.21.15.5:0/2950439553 shutdown_connections 2024-01-24T15:40:13.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.881+0000 7fb480a00700 1 -- 172.21.15.5:0/2950439553 wait complete. 2024-01-24T15:40:13.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.882+0000 7fb480a00700 1 Processor -- start 2024-01-24T15:40:13.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.882+0000 7fb480a00700 1 -- start start 2024-01-24T15:40:13.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.882+0000 7fb480a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb478100d30 0x7fb4781969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:13.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.882+0000 7fb480a00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb478101f20 0x7fb478196f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:13.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.882+0000 7fb480a00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4781028c0 0x7fb47819df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:13.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.882+0000 7fb480a00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47819e540 con 0x7fb4781028c0 2024-01-24T15:40:13.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.882+0000 7fb480a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47819e680 con 0x7fb478100d30 2024-01-24T15:40:13.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.882+0000 7fb480a00700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47819e810 con 0x7fb478101f20 2024-01-24T15:40:13.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.882+0000 7fb47ea00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4781028c0 0x7fb47819df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:13.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.882+0000 7fb47e000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb478100d30 0x7fb4781969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:13.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.882+0000 7fb47e000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb478100d30 0x7fb4781969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.5:39356/0 (socket says 172.21.15.5:39356) 2024-01-24T15:40:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.882+0000 7fb47ea00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4781028c0 0x7fb47819df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50250/0 (socket says 172.21.15.5:50250) 2024-01-24T15:40:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.882+0000 7fb47e000700 1 -- 172.21.15.5:0/3891018903 learned_addr learned my addr 172.21.15.5:0/3891018903 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:40:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.883+0000 7fb47d600700 1 --2- 172.21.15.5:0/3891018903 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb478101f20 0x7fb478196f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.883+0000 7fb47e000700 1 -- 172.21.15.5:0/3891018903 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb478101f20 msgr2=0x7fb478196f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.883+0000 7fb47e000700 1 --2- 172.21.15.5:0/3891018903 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb478101f20 0x7fb478196f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.883+0000 7fb47e000700 1 -- 172.21.15.5:0/3891018903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4781028c0 msgr2=0x7fb47819df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.883+0000 7fb47e000700 1 --2- 172.21.15.5:0/3891018903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4781028c0 0x7fb47819df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.883+0000 7fb47e000700 1 -- 172.21.15.5:0/3891018903 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4600095f0 con 0x7fb478100d30 2024-01-24T15:40:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.883+0000 7fb47d600700 1 --2- 172.21.15.5:0/3891018903 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb478101f20 0x7fb478196f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T15:40:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.883+0000 7fb47ea00700 1 --2- 172.21.15.5:0/3891018903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4781028c0 0x7fb47819df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-24T15:40:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.883+0000 7fb47e000700 1 --2- 172.21.15.5:0/3891018903 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb478100d30 0x7fb4781969c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb46800e970 tx=0x7fb46800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.884+0000 7fb476a00700 1 -- 172.21.15.5:0/3891018903 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb468009790 con 0x7fb478100d30 2024-01-24T15:40:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.884+0000 7fb476a00700 1 -- 172.21.15.5:0/3891018903 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb46800eec0 con 0x7fb478100d30 2024-01-24T15:40:13.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.884+0000 7fb480a00700 1 -- 172.21.15.5:0/3891018903 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb47819eaf0 con 0x7fb478100d30 2024-01-24T15:40:13.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.884+0000 7fb476a00700 1 -- 172.21.15.5:0/3891018903 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb468003c10 con 0x7fb478100d30 2024-01-24T15:40:13.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.884+0000 7fb480a00700 1 -- 172.21.15.5:0/3891018903 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb47819f050 con 0x7fb478100d30 2024-01-24T15:40:13.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.885+0000 7fb480a00700 1 -- 172.21.15.5:0/3891018903 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb47810c440 con 0x7fb478100d30 2024-01-24T15:40:13.890 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.887+0000 7fb476a00700 1 -- 172.21.15.5:0/3891018903 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7fb468003d90 con 0x7fb478100d30 2024-01-24T15:40:13.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.889+0000 7fb476a00700 1 --2- 172.21.15.5:0/3891018903 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fb4580a05a0 0x7fb4580a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:13.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.889+0000 7fb476a00700 1 -- 172.21.15.5:0/3891018903 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb468014070 con 0x7fb478100d30 2024-01-24T15:40:13.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.889+0000 7fb47d600700 1 --2- 172.21.15.5:0/3891018903 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fb4580a05a0 0x7fb4580a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:13.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.890+0000 7fb47d600700 1 --2- 172.21.15.5:0/3891018903 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fb4580a05a0 0x7fb4580a2a60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb46000b580 tx=0x7fb46001a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:13.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:13.896+0000 7fb476a00700 1 -- 172.21.15.5:0/3891018903 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7fb4680958a0 con 0x7fb478100d30 2024-01-24T15:40:13.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:13 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:13.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:13 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:13.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:13 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:13.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:13 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:13.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:13 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:13.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:13 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:13.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:13 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/3757693984' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:40:13.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:13 smithi005 ceph-mon[35346]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:13.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:13 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/4048954546' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-24T15:40:13.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:13 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:40:13.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:13 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:40:13.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:13 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:14.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.111+0000 7fb480a00700 1 -- 172.21.15.5:0/3891018903 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb478107d40 con 0x7fb478100d30 2024-01-24T15:40:14.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.112+0000 7fb476a00700 1 -- 172.21.15.5:0/3891018903 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb468095030 con 0x7fb478100d30 2024-01-24T15:40:14.115 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-01-24T15:40:14.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.115+0000 7fb480a00700 1 -- 172.21.15.5:0/3891018903 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fb4580a05a0 msgr2=0x7fb4580a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:14.117 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.115+0000 7fb480a00700 1 --2- 172.21.15.5:0/3891018903 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fb4580a05a0 0x7fb4580a2a60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb46000b580 tx=0x7fb46001a040 comp rx=0 tx=0).stop 2024-01-24T15:40:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.115+0000 7fb480a00700 1 -- 172.21.15.5:0/3891018903 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb478100d30 msgr2=0x7fb4781969c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.115+0000 7fb480a00700 1 --2- 172.21.15.5:0/3891018903 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb478100d30 0x7fb4781969c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb46800e970 tx=0x7fb46800ec80 comp rx=0 tx=0).stop 2024-01-24T15:40:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.115+0000 7fb480a00700 1 -- 172.21.15.5:0/3891018903 shutdown_connections 2024-01-24T15:40:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.115+0000 7fb480a00700 1 --2- 172.21.15.5:0/3891018903 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fb4580a05a0 0x7fb4580a2a60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.115+0000 7fb480a00700 1 --2- 172.21.15.5:0/3891018903 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb4781028c0 0x7fb47819df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.115+0000 7fb480a00700 1 --2- 172.21.15.5:0/3891018903 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb478100d30 0x7fb4781969c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.115+0000 7fb480a00700 1 --2- 172.21.15.5:0/3891018903 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fb478101f20 0x7fb478196f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.115+0000 7fb480a00700 1 -- 172.21.15.5:0/3891018903 >> 172.21.15.5:0/3891018903 conn(0x7fb4780fc280 msgr2=0x7fb4780fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.115+0000 7fb480a00700 1 -- 172.21.15.5:0/3891018903 shutdown_connections 2024-01-24T15:40:14.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.115+0000 7fb480a00700 1 -- 172.21.15.5:0/3891018903 wait complete. 2024-01-24T15:40:14.137 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-24T15:40:14.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:13 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:14.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:13 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:14.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:13 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:14.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:13 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:14.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:13 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:14.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:13 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:14.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:13 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/3757693984' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:40:14.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:13 smithi204 ceph-mon[39634]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:14.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:13 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/4048954546' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-24T15:40:14.225 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:13 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:40:14.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:13 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:40:14.226 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:13 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:14.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:13 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:14.256 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:13 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:14.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:13 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:14.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:13 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:14.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:13 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:14.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:13 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:14.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:13 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/3757693984' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-24T15:40:14.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:13 smithi160 ceph-mon[38982]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:14.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:13 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/4048954546' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-24T15:40:14.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:13 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:40:14.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:13 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:40:14.257 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:13 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:14.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.337+0000 7fd64f800700 1 -- 172.21.15.5:0/3373009671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd648102f40 msgr2=0x7fd648103360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:14.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.337+0000 7fd64f800700 1 --2- 172.21.15.5:0/3373009671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd648102f40 0x7fd648103360 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd638009990 tx=0x7fd638009ca0 comp rx=0 tx=0).stop 2024-01-24T15:40:14.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.337+0000 7fd64f800700 1 -- 172.21.15.5:0/3373009671 shutdown_connections 2024-01-24T15:40:14.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.337+0000 7fd64f800700 1 --2- 172.21.15.5:0/3373009671 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd648104a50 0x7fd64810b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:14.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.337+0000 7fd64f800700 1 --2- 172.21.15.5:0/3373009671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd648102f40 0x7fd648103360 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:14.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.337+0000 7fd64f800700 1 --2- 172.21.15.5:0/3373009671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd648104090 0x7fd648104510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:14.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.337+0000 7fd64f800700 1 -- 172.21.15.5:0/3373009671 >> 172.21.15.5:0/3373009671 conn(0x7fd6480fe490 msgr2=0x7fd6481008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:14.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.337+0000 7fd64f800700 1 -- 172.21.15.5:0/3373009671 shutdown_connections 2024-01-24T15:40:14.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.337+0000 7fd64f800700 1 -- 172.21.15.5:0/3373009671 wait complete. 2024-01-24T15:40:14.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.338+0000 7fd64f800700 1 Processor -- start 2024-01-24T15:40:14.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.338+0000 7fd64f800700 1 -- start start 2024-01-24T15:40:14.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.338+0000 7fd64f800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd648102f40 0x7fd648198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:14.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.338+0000 7fd64f800700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd648104090 0x7fd648199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:14.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.338+0000 7fd64f800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd648104a50 0x7fd6481a0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:14.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.338+0000 7fd64f800700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6481a06d0 con 0x7fd648104a50 2024-01-24T15:40:14.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.338+0000 7fd64f800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6481a0810 con 0x7fd648102f40 2024-01-24T15:40:14.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.338+0000 7fd64f800700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6481a09a0 con 0x7fd648104090 2024-01-24T15:40:14.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.339+0000 7fd64ce00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd648102f40 0x7fd648198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:14.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.339+0000 7fd64ce00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd648102f40 0x7fd648198b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.5:39374/0 (socket says 172.21.15.5:39374) 2024-01-24T15:40:14.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.339+0000 7fd64ce00700 1 -- 172.21.15.5:0/2259433798 learned_addr learned my addr 172.21.15.5:0/2259433798 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:40:14.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.339+0000 7fd647e00700 1 --2- 172.21.15.5:0/2259433798 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd648104090 0x7fd648199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:14.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.339+0000 7fd64d800700 1 --2- 172.21.15.5:0/2259433798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd648104a50 0x7fd6481a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:14.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.339+0000 7fd64ce00700 1 -- 172.21.15.5:0/2259433798 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd648104090 msgr2=0x7fd648199090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:14.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.339+0000 7fd64ce00700 1 --2- 172.21.15.5:0/2259433798 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd648104090 0x7fd648199090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:14.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.339+0000 7fd64ce00700 1 -- 172.21.15.5:0/2259433798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd648104a50 msgr2=0x7fd6481a0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:14.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.339+0000 7fd64ce00700 1 --2- 172.21.15.5:0/2259433798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd648104a50 0x7fd6481a0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:14.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.339+0000 7fd64ce00700 1 -- 172.21.15.5:0/2259433798 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6380095f0 con 0x7fd648102f40 2024-01-24T15:40:14.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.339+0000 7fd64ce00700 1 --2- 172.21.15.5:0/2259433798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd648102f40 0x7fd648198b50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd638005910 tx=0x7fd638005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:14.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.340+0000 7fd645600700 1 -- 172.21.15.5:0/2259433798 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63801d070 con 0x7fd648102f40 2024-01-24T15:40:14.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.340+0000 7fd64f800700 1 -- 172.21.15.5:0/2259433798 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6481a0c20 con 0x7fd648102f40 2024-01-24T15:40:14.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.340+0000 7fd645600700 1 -- 172.21.15.5:0/2259433798 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd63800be10 con 0x7fd648102f40 2024-01-24T15:40:14.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.340+0000 7fd645600700 1 -- 172.21.15.5:0/2259433798 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd638022e00 con 0x7fd648102f40 2024-01-24T15:40:14.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.340+0000 7fd64f800700 1 -- 172.21.15.5:0/2259433798 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6481a1050 con 0x7fd648102f40 2024-01-24T15:40:14.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.341+0000 7fd64f800700 1 -- 172.21.15.5:0/2259433798 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd648109ee0 con 0x7fd648102f40 2024-01-24T15:40:14.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.343+0000 7fd645600700 1 -- 172.21.15.5:0/2259433798 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7fd63800b980 con 0x7fd648102f40 2024-01-24T15:40:14.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.344+0000 7fd645600700 1 --2- 172.21.15.5:0/2259433798 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fd6280a0570 0x7fd6280a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:14.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.344+0000 7fd645600700 1 -- 172.21.15.5:0/2259433798 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd6380cd250 con 0x7fd648102f40 2024-01-24T15:40:14.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.344+0000 7fd647e00700 1 --2- 172.21.15.5:0/2259433798 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fd6280a0570 0x7fd6280a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:14.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.345+0000 7fd647e00700 1 --2- 172.21.15.5:0/2259433798 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fd6280a0570 0x7fd6280a2a30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd630009c60 tx=0x7fd630009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:14.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.351+0000 7fd645600700 1 -- 172.21.15.5:0/2259433798 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7fd638097280 con 0x7fd648102f40 2024-01-24T15:40:14.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.579+0000 7fd64f800700 1 -- 172.21.15.5:0/2259433798 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd64802cec0 con 0x7fd648102f40 2024-01-24T15:40:14.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.580+0000 7fd645600700 1 -- 172.21.15.5:0/2259433798 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v78) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd63809a8a0 con 0x7fd648102f40 2024-01-24T15:40:14.582 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:40:14.583 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-01-24T15:40:14.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-01-24T15:40:14.583 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-01-24T15:40:14.583 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-01-24T15:40:14.583 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-01-24T15:40:14.583 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-01-24T15:40:14.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.582+0000 7fd64f800700 1 -- 172.21.15.5:0/2259433798 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fd6280a0570 msgr2=0x7fd6280a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:14.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.582+0000 7fd64f800700 1 --2- 172.21.15.5:0/2259433798 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fd6280a0570 0x7fd6280a2a30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd630009c60 tx=0x7fd630009260 comp rx=0 tx=0).stop 2024-01-24T15:40:14.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.582+0000 7fd64f800700 1 -- 172.21.15.5:0/2259433798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd648102f40 msgr2=0x7fd648198b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:14.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.582+0000 7fd64f800700 1 --2- 172.21.15.5:0/2259433798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd648102f40 0x7fd648198b50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd638005910 tx=0x7fd638005740 comp rx=0 tx=0).stop 2024-01-24T15:40:14.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.582+0000 7fd64f800700 1 -- 172.21.15.5:0/2259433798 shutdown_connections 2024-01-24T15:40:14.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.582+0000 7fd64f800700 1 --2- 172.21.15.5:0/2259433798 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fd6280a0570 0x7fd6280a2a30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:14.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.582+0000 7fd64f800700 1 --2- 172.21.15.5:0/2259433798 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd648104a50 0x7fd6481a0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:14.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.582+0000 7fd64f800700 1 --2- 172.21.15.5:0/2259433798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd648102f40 0x7fd648198b50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:14.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.582+0000 7fd64f800700 1 --2- 172.21.15.5:0/2259433798 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd648104090 0x7fd648199090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:14.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.582+0000 7fd64f800700 1 -- 172.21.15.5:0/2259433798 >> 172.21.15.5:0/2259433798 conn(0x7fd6480fe490 msgr2=0x7fd6481007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:14.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.582+0000 7fd64f800700 1 -- 172.21.15.5:0/2259433798 shutdown_connections 2024-01-24T15:40:14.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.582+0000 7fd64f800700 1 -- 172.21.15.5:0/2259433798 wait complete. 2024-01-24T15:40:14.611 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-24T15:40:14.611 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-24T15:40:14.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.823+0000 7fcce9000700 1 -- 172.21.15.5:0/2577249550 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcce4106ab0 msgr2=0x7fcce4108ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:14.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.823+0000 7fcce9000700 1 --2- 172.21.15.5:0/2577249550 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcce4106ab0 0x7fcce4108ea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fccdc00b0a0 tx=0x7fccdc00b3b0 comp rx=0 tx=0).stop 2024-01-24T15:40:14.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.824+0000 7fcce9000700 1 -- 172.21.15.5:0/2577249550 shutdown_connections 2024-01-24T15:40:14.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.824+0000 7fcce9000700 1 --2- 172.21.15.5:0/2577249550 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcce4106ab0 0x7fcce4108ea0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:14.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.824+0000 7fcce9000700 1 --2- 172.21.15.5:0/2577249550 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce4101850 0x7fcce4103c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:14.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.824+0000 7fcce9000700 1 --2- 172.21.15.5:0/2577249550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcce4104180 0x7fcce4106570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:14.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.824+0000 7fcce9000700 1 -- 172.21.15.5:0/2577249550 >> 172.21.15.5:0/2577249550 conn(0x7fcce40fb1a0 msgr2=0x7fcce40fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:14.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.824+0000 7fcce9000700 1 -- 172.21.15.5:0/2577249550 shutdown_connections 2024-01-24T15:40:14.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.824+0000 7fcce9000700 1 -- 172.21.15.5:0/2577249550 wait complete. 2024-01-24T15:40:14.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.825+0000 7fcce9000700 1 Processor -- start 2024-01-24T15:40:14.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.825+0000 7fcce9000700 1 -- start start 2024-01-24T15:40:14.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.825+0000 7fcce9000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcce4101850 0x7fcce41011c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.825+0000 7fcce9000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcce4104180 0x7fcce40ff800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.825+0000 7fcce9000700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce4106ab0 0x7fcce40ffd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.825+0000 7fcce9000700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce41004e0 con 0x7fcce4101850 2024-01-24T15:40:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.825+0000 7fcce9000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4100650 con 0x7fcce4104180 2024-01-24T15:40:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.825+0000 7fcce9000700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce41a0a90 con 0x7fcce4106ab0 2024-01-24T15:40:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.825+0000 7fcce1e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcce4101850 0x7fcce41011c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.825+0000 7fcce1e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcce4101850 0x7fcce41011c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50292/0 (socket says 172.21.15.5:50292) 2024-01-24T15:40:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.825+0000 7fcce1e00700 1 -- 172.21.15.5:0/152734337 learned_addr learned my addr 172.21.15.5:0/152734337 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:40:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.825+0000 7fcce1400700 1 --2- 172.21.15.5:0/152734337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcce4104180 0x7fcce40ff800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.826+0000 7fcce2800700 1 --2- 172.21.15.5:0/152734337 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce4106ab0 0x7fcce40ffd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.826+0000 7fcce1e00700 1 -- 172.21.15.5:0/152734337 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce4106ab0 msgr2=0x7fcce40ffd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:14.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.826+0000 7fcce1e00700 1 --2- 172.21.15.5:0/152734337 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce4106ab0 0x7fcce40ffd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:14.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.826+0000 7fcce1e00700 1 -- 172.21.15.5:0/152734337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcce4104180 msgr2=0x7fcce40ff800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:14.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.826+0000 7fcce1e00700 1 --2- 172.21.15.5:0/152734337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcce4104180 0x7fcce40ff800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:14.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.826+0000 7fcce1e00700 1 -- 172.21.15.5:0/152734337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc009d00 con 0x7fcce4101850 2024-01-24T15:40:14.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.826+0000 7fcce1e00700 1 --2- 172.21.15.5:0/152734337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcce4101850 0x7fcce41011c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fccd400e9a0 tx=0x7fccd400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:14.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.826+0000 7fccdaa00700 1 -- 172.21.15.5:0/152734337 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4009790 con 0x7fcce4101850 2024-01-24T15:40:14.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.826+0000 7fccdaa00700 1 -- 172.21.15.5:0/152734337 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fccd4010430 con 0x7fcce4101850 2024-01-24T15:40:14.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.826+0000 7fcce9000700 1 -- 172.21.15.5:0/152734337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce41a0d70 con 0x7fcce4101850 2024-01-24T15:40:14.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.826+0000 7fccdaa00700 1 -- 172.21.15.5:0/152734337 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd400cea0 con 0x7fcce4101850 2024-01-24T15:40:14.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.827+0000 7fcce9000700 1 -- 172.21.15.5:0/152734337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce41a11a0 con 0x7fcce4101850 2024-01-24T15:40:14.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.828+0000 7fcce9000700 1 -- 172.21.15.5:0/152734337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce410c3c0 con 0x7fcce4101850 2024-01-24T15:40:14.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.830+0000 7fccdaa00700 1 -- 172.21.15.5:0/152734337 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7fccd40105a0 con 0x7fcce4101850 2024-01-24T15:40:14.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.831+0000 7fccdaa00700 1 --2- 172.21.15.5:0/152734337 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fccc40a0520 0x7fccc40a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:14.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.831+0000 7fccdaa00700 1 -- 172.21.15.5:0/152734337 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fccd4014070 con 0x7fcce4101850 2024-01-24T15:40:14.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.831+0000 7fcce1400700 1 --2- 172.21.15.5:0/152734337 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fccc40a0520 0x7fccc40a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:14.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.832+0000 7fcce1400700 1 --2- 172.21.15.5:0/152734337 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fccc40a0520 0x7fccc40a29e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcccc009c60 tx=0x7fcccc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:14.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:14.836+0000 7fccdaa00700 1 -- 172.21.15.5:0/152734337 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7fccd4052120 con 0x7fcce4101850 2024-01-24T15:40:15.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:15.057+0000 7fcce9000700 1 -- 172.21.15.5:0/152734337 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcce410c5b0 con 0x7fcce4101850 2024-01-24T15:40:15.432 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:15 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:40:15.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:15 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/3891018903' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-24T15:40:15.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:15 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/2259433798' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-01-24T15:40:15.474 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:15 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:40:15.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:15 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/3891018903' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-24T15:40:15.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:15 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/2259433798' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-01-24T15:40:15.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:15 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-24T15:40:15.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:15 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/3891018903' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-24T15:40:15.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:15 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/2259433798' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-01-24T15:40:16.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.045+0000 7fccdaa00700 1 -- 172.21.15.5:0/152734337 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v79) v1 ==== 138+0+0 (secure 0 0 0) 0x7fccd4099150 con 0x7fcce4101850 2024-01-24T15:40:16.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.050+0000 7fcce9000700 1 -- 172.21.15.5:0/152734337 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fccc40a0520 msgr2=0x7fccc40a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:16.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.050+0000 7fcce9000700 1 --2- 172.21.15.5:0/152734337 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fccc40a0520 0x7fccc40a29e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcccc009c60 tx=0x7fcccc009260 comp rx=0 tx=0).stop 2024-01-24T15:40:16.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.050+0000 7fcce9000700 1 -- 172.21.15.5:0/152734337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcce4101850 msgr2=0x7fcce41011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:16.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.050+0000 7fcce9000700 1 --2- 172.21.15.5:0/152734337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcce4101850 0x7fcce41011c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fccd400e9a0 tx=0x7fccd400ecb0 comp rx=0 tx=0).stop 2024-01-24T15:40:16.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.050+0000 7fcce9000700 1 -- 172.21.15.5:0/152734337 shutdown_connections 2024-01-24T15:40:16.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.050+0000 7fcce9000700 1 --2- 172.21.15.5:0/152734337 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fcce4106ab0 0x7fcce40ffd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:16.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.050+0000 7fcce9000700 1 --2- 172.21.15.5:0/152734337 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fccc40a0520 0x7fccc40a29e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:16.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.050+0000 7fcce9000700 1 --2- 172.21.15.5:0/152734337 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcce4101850 0x7fcce41011c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:16.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.050+0000 7fcce9000700 1 --2- 172.21.15.5:0/152734337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcce4104180 0x7fcce40ff800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:16.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.050+0000 7fcce9000700 1 -- 172.21.15.5:0/152734337 >> 172.21.15.5:0/152734337 conn(0x7fcce40fb1a0 msgr2=0x7fcce4102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:16.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.050+0000 7fcce9000700 1 -- 172.21.15.5:0/152734337 shutdown_connections 2024-01-24T15:40:16.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.051+0000 7fcce9000700 1 -- 172.21.15.5:0/152734337 wait complete. 2024-01-24T15:40:16.054 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-01-24T15:40:16.073 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-24T15:40:16.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.302+0000 7f3579800700 1 -- 172.21.15.5:0/2774196459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3574101f20 msgr2=0x7f3574102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:16.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.302+0000 7f3579800700 1 --2- 172.21.15.5:0/2774196459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3574101f20 0x7f3574102380 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f355c0099c0 tx=0x7f355c009cd0 comp rx=0 tx=0).stop 2024-01-24T15:40:16.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.302+0000 7f3579800700 1 -- 172.21.15.5:0/2774196459 shutdown_connections 2024-01-24T15:40:16.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.302+0000 7f3579800700 1 --2- 172.21.15.5:0/2774196459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35741028c0 0x7f3574109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:16.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.302+0000 7f3579800700 1 --2- 172.21.15.5:0/2774196459 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3574100d30 0x7f3574101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:16.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.302+0000 7f3579800700 1 --2- 172.21.15.5:0/2774196459 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3574101f20 0x7f3574102380 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:16.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.302+0000 7f3579800700 1 -- 172.21.15.5:0/2774196459 >> 172.21.15.5:0/2774196459 conn(0x7f35740fc280 msgr2=0x7f35740fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:16.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.302+0000 7f3579800700 1 -- 172.21.15.5:0/2774196459 shutdown_connections 2024-01-24T15:40:16.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.302+0000 7f3579800700 1 -- 172.21.15.5:0/2774196459 wait complete. 2024-01-24T15:40:16.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.303+0000 7f3579800700 1 Processor -- start 2024-01-24T15:40:16.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.303+0000 7f3579800700 1 -- start start 2024-01-24T15:40:16.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.303+0000 7f3579800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3574100d30 0x7f3574074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.303+0000 7f3579800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3574101f20 0x7f3574073130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.303+0000 7f3579800700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f35741028c0 0x7f3574073670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.303+0000 7f3579800700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3574073e10 con 0x7f3574101f20 2024-01-24T15:40:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.303+0000 7f3579800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3574073f80 con 0x7f3574100d30 2024-01-24T15:40:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.303+0000 7f3579800700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35741a0a50 con 0x7f35741028c0 2024-01-24T15:40:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.304+0000 7f3572000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3574101f20 0x7f3574073130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.304+0000 7f3572a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3574100d30 0x7f3574074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.304+0000 7f3572000700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3574101f20 0x7f3574073130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50316/0 (socket says 172.21.15.5:50316) 2024-01-24T15:40:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.304+0000 7f3572000700 1 -- 172.21.15.5:0/2079192212 learned_addr learned my addr 172.21.15.5:0/2079192212 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:40:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.304+0000 7f3573400700 1 --2- 172.21.15.5:0/2079192212 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f35741028c0 0x7f3574073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.304+0000 7f3572000700 1 -- 172.21.15.5:0/2079192212 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f35741028c0 msgr2=0x7f3574073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.304+0000 7f3572000700 1 --2- 172.21.15.5:0/2079192212 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f35741028c0 0x7f3574073670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.304+0000 7f3572000700 1 -- 172.21.15.5:0/2079192212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3574100d30 msgr2=0x7f3574074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:16.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.304+0000 7f3572000700 1 --2- 172.21.15.5:0/2079192212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3574100d30 0x7f3574074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.304+0000 7f3572000700 1 -- 172.21.15.5:0/2079192212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c0095f0 con 0x7f3574101f20 2024-01-24T15:40:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.304+0000 7f3572000700 1 --2- 172.21.15.5:0/2079192212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3574101f20 0x7f3574073130 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f355c000c00 tx=0x7f355c00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.304+0000 7f356b400700 1 -- 172.21.15.5:0/2079192212 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c01d070 con 0x7f3574101f20 2024-01-24T15:40:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.305+0000 7f356b400700 1 -- 172.21.15.5:0/2079192212 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f355c00fdc0 con 0x7f3574101f20 2024-01-24T15:40:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.305+0000 7f356b400700 1 -- 172.21.15.5:0/2079192212 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c0173f0 con 0x7f3574101f20 2024-01-24T15:40:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.305+0000 7f3579800700 1 -- 172.21.15.5:0/2079192212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35741a0cd0 con 0x7f3574101f20 2024-01-24T15:40:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.305+0000 7f3579800700 1 -- 172.21.15.5:0/2079192212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35741a10a0 con 0x7f3574101f20 2024-01-24T15:40:16.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.306+0000 7f3579800700 1 -- 172.21.15.5:0/2079192212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357410c4b0 con 0x7f3574101f20 2024-01-24T15:40:16.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.308+0000 7f356b400700 1 -- 172.21.15.5:0/2079192212 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f355c022470 con 0x7f3574101f20 2024-01-24T15:40:16.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.309+0000 7f356b400700 1 --2- 172.21.15.5:0/2079192212 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f35540a0520 0x7f35540a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:16.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.309+0000 7f356b400700 1 -- 172.21.15.5:0/2079192212 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f355c0cca60 con 0x7f3574101f20 2024-01-24T15:40:16.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.309+0000 7f3572a00700 1 --2- 172.21.15.5:0/2079192212 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f35540a0520 0x7f35540a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:16.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.310+0000 7f3572a00700 1 --2- 172.21.15.5:0/2079192212 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f35540a0520 0x7f35540a29e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3574101d80 tx=0x7f356400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:16.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.312+0000 7f356b400700 1 -- 172.21.15.5:0/2079192212 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f355c096920 con 0x7f3574101f20 2024-01-24T15:40:16.432 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:16 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/152734337' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-01-24T15:40:16.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:16 smithi005 ceph-mon[35346]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:16.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:16 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:16.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:16 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:16.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:16 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:16.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:16 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:16.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:16 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:16.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:16 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:16.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:16 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:40:16.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:16 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:40:16.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:16 smithi005 ceph-mon[35346]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:16.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:16 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/152734337' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-01-24T15:40:16.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:16 smithi204 ceph-mon[39634]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:16.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:16 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:16.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:16 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:16.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:16 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:16.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:16 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:16.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:16 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:16.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:16 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:16.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:16 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:40:16.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:16 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:40:16.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:16 smithi204 ceph-mon[39634]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:16.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:16 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/152734337' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-01-24T15:40:16.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:16 smithi160 ceph-mon[38982]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:16.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:16 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:16.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:16 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:16.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:16 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:16.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:16 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:16.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:16 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:16.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:16 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:16.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:16 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-24T15:40:16.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:16 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-24T15:40:16.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:16 smithi160 ceph-mon[38982]: from='mgr.14150 172.21.15.5:0/729335895' entity='mgr.x' 2024-01-24T15:40:16.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:16.527+0000 7f3579800700 1 -- 172.21.15.5:0/2079192212 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3574107d30 con 0x7f3574101f20 2024-01-24T15:40:17.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.048+0000 7f356b400700 1 -- 172.21.15.5:0/2079192212 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v80) v1 ==== 170+0+0 (secure 0 0 0) 0x7f355c099f40 con 0x7f3574101f20 2024-01-24T15:40:17.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.055+0000 7f3579800700 1 -- 172.21.15.5:0/2079192212 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f35540a0520 msgr2=0x7f35540a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:17.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.055+0000 7f3579800700 1 --2- 172.21.15.5:0/2079192212 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f35540a0520 0x7f35540a29e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3574101d80 tx=0x7f356400b410 comp rx=0 tx=0).stop 2024-01-24T15:40:17.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.055+0000 7f3579800700 1 -- 172.21.15.5:0/2079192212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3574101f20 msgr2=0x7f3574073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:17.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.055+0000 7f3579800700 1 --2- 172.21.15.5:0/2079192212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3574101f20 0x7f3574073130 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f355c000c00 tx=0x7f355c00fa00 comp rx=0 tx=0).stop 2024-01-24T15:40:17.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.056+0000 7f3579800700 1 -- 172.21.15.5:0/2079192212 shutdown_connections 2024-01-24T15:40:17.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.056+0000 7f3579800700 1 --2- 172.21.15.5:0/2079192212 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f35741028c0 0x7f3574073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:17.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.056+0000 7f3579800700 1 --2- 172.21.15.5:0/2079192212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3574100d30 0x7f3574074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:17.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.056+0000 7f3579800700 1 --2- 172.21.15.5:0/2079192212 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f35540a0520 0x7f35540a29e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:17.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.056+0000 7f3579800700 1 --2- 172.21.15.5:0/2079192212 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3574101f20 0x7f3574073130 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:17.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.056+0000 7f3579800700 1 -- 172.21.15.5:0/2079192212 >> 172.21.15.5:0/2079192212 conn(0x7f35740fc280 msgr2=0x7f35740fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:17.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.057+0000 7f3579800700 1 -- 172.21.15.5:0/2079192212 shutdown_connections 2024-01-24T15:40:17.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.059+0000 7f3579800700 1 -- 172.21.15.5:0/2079192212 wait complete. 2024-01-24T15:40:17.066 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-01-24T15:40:17.089 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-24T15:40:17.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.288+0000 7f5af4200700 1 -- 172.21.15.5:0/400578252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5aec101f20 msgr2=0x7f5aec102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:17.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.288+0000 7f5af4200700 1 --2- 172.21.15.5:0/400578252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5aec101f20 0x7f5aec102380 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5ad40099c0 tx=0x7f5ad4009cd0 comp rx=0 tx=0).stop 2024-01-24T15:40:17.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.288+0000 7f5af4200700 1 -- 172.21.15.5:0/400578252 shutdown_connections 2024-01-24T15:40:17.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.288+0000 7f5af4200700 1 --2- 172.21.15.5:0/400578252 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5aec1028c0 0x7f5aec109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:17.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.288+0000 7f5af4200700 1 --2- 172.21.15.5:0/400578252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5aec100d30 0x7f5aec101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:17.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.288+0000 7f5af4200700 1 --2- 172.21.15.5:0/400578252 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5aec101f20 0x7f5aec102380 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:17.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.288+0000 7f5af4200700 1 -- 172.21.15.5:0/400578252 >> 172.21.15.5:0/400578252 conn(0x7f5aec0fc280 msgr2=0x7f5aec0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:17.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.289+0000 7f5af4200700 1 -- 172.21.15.5:0/400578252 shutdown_connections 2024-01-24T15:40:17.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.289+0000 7f5af4200700 1 -- 172.21.15.5:0/400578252 wait complete. 2024-01-24T15:40:17.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.289+0000 7f5af4200700 1 Processor -- start 2024-01-24T15:40:17.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.290+0000 7f5af4200700 1 -- start start 2024-01-24T15:40:17.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.290+0000 7f5af4200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5aec100d30 0x7f5aec074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:17.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.290+0000 7f5af4200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5aec101f20 0x7f5aec073130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:17.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.290+0000 7f5af4200700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5aec1028c0 0x7f5aec073670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:17.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.290+0000 7f5af4200700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec073e10 con 0x7f5aec100d30 2024-01-24T15:40:17.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.290+0000 7f5af4200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec073f80 con 0x7f5aec101f20 2024-01-24T15:40:17.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.290+0000 7f5af4200700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec1a0a00 con 0x7f5aec1028c0 2024-01-24T15:40:17.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.290+0000 7f5af1800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5aec100d30 0x7f5aec074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:17.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.290+0000 7f5af1800700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5aec100d30 0x7f5aec074af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50322/0 (socket says 172.21.15.5:50322) 2024-01-24T15:40:17.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.290+0000 7f5af1800700 1 -- 172.21.15.5:0/3983849894 learned_addr learned my addr 172.21.15.5:0/3983849894 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:40:17.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.290+0000 7f5af2200700 1 --2- 172.21.15.5:0/3983849894 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5aec1028c0 0x7f5aec073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:17.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.291+0000 7f5af0e00700 1 --2- 172.21.15.5:0/3983849894 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5aec101f20 0x7f5aec073130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:17.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.291+0000 7f5af1800700 1 -- 172.21.15.5:0/3983849894 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5aec1028c0 msgr2=0x7f5aec073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:17.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.291+0000 7f5af1800700 1 --2- 172.21.15.5:0/3983849894 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5aec1028c0 0x7f5aec073670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:17.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.291+0000 7f5af1800700 1 -- 172.21.15.5:0/3983849894 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5aec101f20 msgr2=0x7f5aec073130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:17.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.291+0000 7f5af1800700 1 --2- 172.21.15.5:0/3983849894 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5aec101f20 0x7f5aec073130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:17.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.291+0000 7f5af1800700 1 -- 172.21.15.5:0/3983849894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad40095f0 con 0x7f5aec100d30 2024-01-24T15:40:17.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.291+0000 7f5af0e00700 1 --2- 172.21.15.5:0/3983849894 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5aec101f20 0x7f5aec073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T15:40:17.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.291+0000 7f5af1800700 1 --2- 172.21.15.5:0/3983849894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5aec100d30 0x7f5aec074af0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00e970 tx=0x7f5adc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:17.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.291+0000 7f5aea000700 1 -- 172.21.15.5:0/3983849894 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc009790 con 0x7f5aec100d30 2024-01-24T15:40:17.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.291+0000 7f5aea000700 1 -- 172.21.15.5:0/3983849894 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5adc0044b0 con 0x7f5aec100d30 2024-01-24T15:40:17.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.291+0000 7f5af4200700 1 -- 172.21.15.5:0/3983849894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aec1a0ce0 con 0x7f5aec100d30 2024-01-24T15:40:17.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.291+0000 7f5aea000700 1 -- 172.21.15.5:0/3983849894 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc003dd0 con 0x7f5aec100d30 2024-01-24T15:40:17.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.291+0000 7f5af4200700 1 -- 172.21.15.5:0/3983849894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aec1a11a0 con 0x7f5aec100d30 2024-01-24T15:40:17.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.292+0000 7f5af4200700 1 -- 172.21.15.5:0/3983849894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aec10c440 con 0x7f5aec100d30 2024-01-24T15:40:17.297 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.294+0000 7f5aea000700 1 -- 172.21.15.5:0/3983849894 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f5adc004000 con 0x7f5aec100d30 2024-01-24T15:40:17.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.296+0000 7f5aea000700 1 --2- 172.21.15.5:0/3983849894 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5acc0a0520 0x7f5acc0a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:17.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.296+0000 7f5aea000700 1 -- 172.21.15.5:0/3983849894 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f5adc014070 con 0x7f5aec100d30 2024-01-24T15:40:17.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.296+0000 7f5af0e00700 1 --2- 172.21.15.5:0/3983849894 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5acc0a0520 0x7f5acc0a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:17.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.297+0000 7f5af0e00700 1 --2- 172.21.15.5:0/3983849894 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5acc0a0520 0x7f5acc0a29e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4006010 tx=0x7f5ad400b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:17.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.298+0000 7f5aea000700 1 -- 172.21.15.5:0/3983849894 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f5adc095950 con 0x7f5aec100d30 2024-01-24T15:40:17.432 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:17 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/152734337' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-01-24T15:40:17.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:17 smithi005 ceph-mon[35346]: osdmap e79: 12 total, 12 up, 12 in 2024-01-24T15:40:17.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:17 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/2079192212' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-01-24T15:40:17.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:17 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/152734337' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-01-24T15:40:17.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:17 smithi204 ceph-mon[39634]: osdmap e79: 12 total, 12 up, 12 in 2024-01-24T15:40:17.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:17 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/2079192212' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-01-24T15:40:17.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:17 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/152734337' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-01-24T15:40:17.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:17 smithi160 ceph-mon[38982]: osdmap e79: 12 total, 12 up, 12 in 2024-01-24T15:40:17.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:17 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/2079192212' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-01-24T15:40:17.560 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.557+0000 7f5af4200700 1 -- 172.21.15.5:0/3983849894 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5aec1a1980 con 0x7f5aec100d30 2024-01-24T15:40:17.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.564+0000 7f5aea000700 1 -- 172.21.15.5:0/3983849894 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5adc082e60 con 0x7f5aec100d30 2024-01-24T15:40:17.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.568+0000 7f5af4200700 1 -- 172.21.15.5:0/3983849894 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5acc0a0520 msgr2=0x7f5acc0a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:17.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.568+0000 7f5af4200700 1 --2- 172.21.15.5:0/3983849894 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5acc0a0520 0x7f5acc0a29e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4006010 tx=0x7f5ad400b540 comp rx=0 tx=0).stop 2024-01-24T15:40:17.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.568+0000 7f5af4200700 1 -- 172.21.15.5:0/3983849894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5aec100d30 msgr2=0x7f5aec074af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:17.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.568+0000 7f5af4200700 1 --2- 172.21.15.5:0/3983849894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5aec100d30 0x7f5aec074af0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00e970 tx=0x7f5adc00ed30 comp rx=0 tx=0).stop 2024-01-24T15:40:17.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.569+0000 7f5af4200700 1 -- 172.21.15.5:0/3983849894 shutdown_connections 2024-01-24T15:40:17.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.569+0000 7f5af4200700 1 --2- 172.21.15.5:0/3983849894 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5aec1028c0 0x7f5aec073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:17.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.569+0000 7f5af4200700 1 --2- 172.21.15.5:0/3983849894 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5acc0a0520 0x7f5acc0a29e0 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4006010 tx=0x7f5ad400b540 comp rx=0 tx=0).stop 2024-01-24T15:40:17.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.569+0000 7f5af4200700 1 --2- 172.21.15.5:0/3983849894 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5aec100d30 0x7f5aec074af0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:17.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.569+0000 7f5af4200700 1 --2- 172.21.15.5:0/3983849894 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5aec101f20 0x7f5aec073130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:17.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.569+0000 7f5af4200700 1 -- 172.21.15.5:0/3983849894 >> 172.21.15.5:0/3983849894 conn(0x7f5aec0fc280 msgr2=0x7f5aec0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:17.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.569+0000 7f5af4200700 1 -- 172.21.15.5:0/3983849894 shutdown_connections 2024-01-24T15:40:17.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.569+0000 7f5af4200700 1 -- 172.21.15.5:0/3983849894 wait complete. 2024-01-24T15:40:17.577 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 2 and data pool 3 2024-01-24T15:40:17.605 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T15:40:17.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.800+0000 7fd9a8600700 1 -- 172.21.15.5:0/874441656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9a0106a00 msgr2=0x7fd9a0108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:17.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.800+0000 7fd9a8600700 1 --2- 172.21.15.5:0/874441656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9a0106a00 0x7fd9a0108e70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd99800b0a0 tx=0x7fd99800b3b0 comp rx=0 tx=0).stop 2024-01-24T15:40:17.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.800+0000 7fd9a8600700 1 -- 172.21.15.5:0/874441656 shutdown_connections 2024-01-24T15:40:17.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.800+0000 7fd9a8600700 1 --2- 172.21.15.5:0/874441656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9a0106a00 0x7fd9a0108e70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:17.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.800+0000 7fd9a8600700 1 --2- 172.21.15.5:0/874441656 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9a01017a0 0x7fd9a0103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:17.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.800+0000 7fd9a8600700 1 --2- 172.21.15.5:0/874441656 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd9a01040d0 0x7fd9a01064c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:17.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.800+0000 7fd9a8600700 1 -- 172.21.15.5:0/874441656 >> 172.21.15.5:0/874441656 conn(0x7fd9a00fb170 msgr2=0x7fd9a00fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:17.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.800+0000 7fd9a8600700 1 -- 172.21.15.5:0/874441656 shutdown_connections 2024-01-24T15:40:17.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.800+0000 7fd9a8600700 1 -- 172.21.15.5:0/874441656 wait complete. 2024-01-24T15:40:17.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.801+0000 7fd9a8600700 1 Processor -- start 2024-01-24T15:40:17.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.802+0000 7fd9a8600700 1 -- start start 2024-01-24T15:40:17.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.802+0000 7fd9a8600700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd9a01017a0 0x7fd9a0198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:17.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.802+0000 7fd9a8600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9a01040d0 0x7fd9a0199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:17.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.802+0000 7fd9a8600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9a0106a00 0x7fd9a01a0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:17.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.802+0000 7fd9a8600700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a01a0750 con 0x7fd9a01040d0 2024-01-24T15:40:17.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.802+0000 7fd9a8600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a01a0890 con 0x7fd9a0106a00 2024-01-24T15:40:17.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.802+0000 7fd9a8600700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a01a0a20 con 0x7fd9a01017a0 2024-01-24T15:40:17.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.802+0000 7fd9a5200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9a01040d0 0x7fd9a0199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:17.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.802+0000 7fd9a5200700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9a01040d0 0x7fd9a0199110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50346/0 (socket says 172.21.15.5:50346) 2024-01-24T15:40:17.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.802+0000 7fd9a5200700 1 -- 172.21.15.5:0/3102280231 learned_addr learned my addr 172.21.15.5:0/3102280231 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:40:17.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.802+0000 7fd9a6600700 1 --2- 172.21.15.5:0/3102280231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9a0106a00 0x7fd9a01a0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:17.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.803+0000 7fd9a5200700 1 -- 172.21.15.5:0/3102280231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd9a01017a0 msgr2=0x7fd9a0198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:17.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.803+0000 7fd9a5c00700 1 --2- 172.21.15.5:0/3102280231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd9a01017a0 0x7fd9a0198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:17.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.803+0000 7fd9a5200700 1 --2- 172.21.15.5:0/3102280231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd9a01017a0 0x7fd9a0198bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:17.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.803+0000 7fd9a5200700 1 -- 172.21.15.5:0/3102280231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9a0106a00 msgr2=0x7fd9a01a0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:17.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.803+0000 7fd9a5200700 1 --2- 172.21.15.5:0/3102280231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9a0106a00 0x7fd9a01a0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:17.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.803+0000 7fd9a5200700 1 -- 172.21.15.5:0/3102280231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd998009d00 con 0x7fd9a01040d0 2024-01-24T15:40:17.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.803+0000 7fd9a6600700 1 --2- 172.21.15.5:0/3102280231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9a0106a00 0x7fd9a01a0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T15:40:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.803+0000 7fd9a5c00700 1 --2- 172.21.15.5:0/3102280231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd9a01017a0 0x7fd9a0198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T15:40:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.803+0000 7fd9a5200700 1 --2- 172.21.15.5:0/3102280231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9a01040d0 0x7fd9a0199110 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd98800e9a0 tx=0x7fd98800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.803+0000 7fd99e000700 1 -- 172.21.15.5:0/3102280231 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd988009790 con 0x7fd9a01040d0 2024-01-24T15:40:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.803+0000 7fd99e000700 1 -- 172.21.15.5:0/3102280231 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd98800cbd0 con 0x7fd9a01040d0 2024-01-24T15:40:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.803+0000 7fd9a8600700 1 -- 172.21.15.5:0/3102280231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a01a0d00 con 0x7fd9a01040d0 2024-01-24T15:40:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.803+0000 7fd99e000700 1 -- 172.21.15.5:0/3102280231 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd988018680 con 0x7fd9a01040d0 2024-01-24T15:40:17.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.803+0000 7fd9a8600700 1 -- 172.21.15.5:0/3102280231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a01a1200 con 0x7fd9a01040d0 2024-01-24T15:40:17.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.804+0000 7fd9a8600700 1 -- 172.21.15.5:0/3102280231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a0108580 con 0x7fd9a01040d0 2024-01-24T15:40:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.806+0000 7fd99e000700 1 -- 172.21.15.5:0/3102280231 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7fd98800cd40 con 0x7fd9a01040d0 2024-01-24T15:40:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.808+0000 7fd99e000700 1 --2- 172.21.15.5:0/3102280231 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fd9800a05f0 0x7fd9800a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:17.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.808+0000 7fd99e000700 1 -- 172.21.15.5:0/3102280231 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd988014070 con 0x7fd9a01040d0 2024-01-24T15:40:17.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.808+0000 7fd9a5c00700 1 --2- 172.21.15.5:0/3102280231 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fd9800a05f0 0x7fd9800a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:17.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.808+0000 7fd9a5c00700 1 --2- 172.21.15.5:0/3102280231 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fd9800a05f0 0x7fd9800a2ab0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd990005d90 tx=0x7fd990005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:17.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:17.812+0000 7fd99e000700 1 -- 172.21.15.5:0/3102280231 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7fd988052120 con 0x7fd9a01040d0 2024-01-24T15:40:18.027 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.025+0000 7fd9a8600700 1 -- 172.21.15.5:0/3102280231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9a002cc70 con 0x7fd9a01040d0 2024-01-24T15:40:18.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.027+0000 7fd99e000700 1 -- 172.21.15.5:0/3102280231 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22086 (secure 0 0 0) 0x7fd988095750 con 0x7fd9a01040d0 2024-01-24T15:40:18.030 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:40:18.030 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":81,"fsid":"bede0bb6-bacd-11ee-95b1-87774f69a715","created":"2024-01-24T15:33:13.568798+0000","modified":"2024-01-24T15:40:17.559911+0000","last_up_change":"2024-01-24T15:39:31.302244+0000","last_in_change":"2024-01-24T15:39:11.995261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T15:36:17.760558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T15:40:15.652636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T15:40:17.041082+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"caab3496-5d11-4c8e-bd4f-ca7cdb6924a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3395335330},{"type":"v1","addr":"172.21.15.5:6803","nonce":3395335330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3395335330},{"type":"v1","addr":"172.21.15.5:6805","nonce":3395335330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3395335330},{"type":"v1","addr":"172.21.15.5:6809","nonce":3395335330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3395335330},{"type":"v1","addr":"172.21.15.5:6807","nonce":3395335330}]},"public_addr":"172.21.15.5:6803/3395335330","cluster_addr":"172.21.15.5:6805/3395335330","heartbeat_back_addr":"172.21.15.5:6809/3395335330","heartbeat_front_addr":"172.21.15.5:6807/3395335330","state":["exists","up"]},{"osd":1,"uuid":"547ee262-816e-46ee-b4d4-8dd267abb2de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1386884060},{"type":"v1","addr":"172.21.15.160:6801","nonce":1386884060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1386884060},{"type":"v1","addr":"172.21.15.160:6803","nonce":1386884060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1386884060},{"type":"v1","addr":"172.21.15.160:6807","nonce":1386884060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1386884060},{"type":"v1","addr":"172.21.15.160:6805","nonce":1386884060}]},"public_addr":"172.21.15.160:6801/1386884060","cluster_addr":"172.21.15.160:6803/1386884060","heartbeat_back_addr":"172.21.15.160:6807/1386884060","heartbeat_front_addr":"172.21.15.160:6805/1386884060","state":["exists","up"]},{"osd":2,"uuid":"b07d96ff-9584-4e71-a846-e8b939918708","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1780238382},{"type":"v1","addr":"172.21.15.204:6801","nonce":1780238382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1780238382},{"type":"v1","addr":"172.21.15.204:6803","nonce":1780238382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1780238382},{"type":"v1","addr":"172.21.15.204:6807","nonce":1780238382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1780238382},{"type":"v1","addr":"172.21.15.204:6805","nonce":1780238382}]},"public_addr":"172.21.15.204:6801/1780238382","cluster_addr":"172.21.15.204:6803/1780238382","heartbeat_back_addr":"172.21.15.204:6807/1780238382","heartbeat_front_addr":"172.21.15.204:6805/1780238382","state":["exists","up"]},{"osd":3,"uuid":"4a086309-5d6b-4226-93d0-e3e55ced7172","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2647874051},{"type":"v1","addr":"172.21.15.5:6811","nonce":2647874051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2647874051},{"type":"v1","addr":"172.21.15.5:6813","nonce":2647874051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2647874051},{"type":"v1","addr":"172.21.15.5:6817","nonce":2647874051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2647874051},{"type":"v1","addr":"172.21.15.5:6815","nonce":2647874051}]},"public_addr":"172.21.15.5:6811/2647874051","cluster_addr":"172.21.15.5:6813/2647874051","heartbeat_back_addr":"172.21.15.5:6817/2647874051","heartbeat_front_addr":"172.21.15.5:6815/2647874051","state":["exists","up"]},{"osd":4,"uuid":"27d27d11-ef97-4faf-b5fb-c744bbdbcf9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4260815326},{"type":"v1","addr":"172.21.15.160:6809","nonce":4260815326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4260815326},{"type":"v1","addr":"172.21.15.160:6811","nonce":4260815326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4260815326},{"type":"v1","addr":"172.21.15.160:6815","nonce":4260815326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4260815326},{"type":"v1","addr":"172.21.15.160:6813","nonce":4260815326}]},"public_addr":"172.21.15.160:6809/4260815326","cluster_addr":"172.21.15.160:6811/4260815326","heartbeat_back_addr":"172.21.15.160:6815/4260815326","heartbeat_front_addr":"172.21.15.160:6813/4260815326","state":["exists","up"]},{"osd":5,"uuid":"12425c52-d7ae-46f9-a949-c089587b3ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":1024339043},{"type":"v1","addr":"172.21.15.204:6809","nonce":1024339043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":1024339043},{"type":"v1","addr":"172.21.15.204:6811","nonce":1024339043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":1024339043},{"type":"v1","addr":"172.21.15.204:6815","nonce":1024339043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":1024339043},{"type":"v1","addr":"172.21.15.204:6813","nonce":1024339043}]},"public_addr":"172.21.15.204:6809/1024339043","cluster_addr":"172.21.15.204:6811/1024339043","heartbeat_back_addr":"172.21.15.204:6815/1024339043","heartbeat_front_addr":"172.21.15.204:6813/1024339043","state":["exists","up"]},{"osd":6,"uuid":"2dda7ced-0f36-4f9e-aa2c-3d2d03990ed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":754402627},{"type":"v1","addr":"172.21.15.5:6819","nonce":754402627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":754402627},{"type":"v1","addr":"172.21.15.5:6821","nonce":754402627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":754402627},{"type":"v1","addr":"172.21.15.5:6825","nonce":754402627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":754402627},{"type":"v1","addr":"172.21.15.5:6823","nonce":754402627}]},"public_addr":"172.21.15.5:6819/754402627","cluster_addr":"172.21.15.5:6821/754402627","heartbeat_back_addr":"172.21.15.5:6825/754402627","heartbeat_front_addr":"172.21.15.5:6823/754402627","state":["exists","up"]},{"osd":7,"uuid":"cafcc179-ee88-44b5-a3b0-e8d772bf8ac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":369148145},{"type":"v1","addr":"172.21.15.160:6817","nonce":369148145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":369148145},{"type":"v1","addr":"172.21.15.160:6819","nonce":369148145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":369148145},{"type":"v1","addr":"172.21.15.160:6823","nonce":369148145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":369148145},{"type":"v1","addr":"172.21.15.160:6821","nonce":369148145}]},"public_addr":"172.21.15.160:6817/369148145","cluster_addr":"172.21.15.160:6819/369148145","heartbeat_back_addr":"172.21.15.160:6823/369148145","heartbeat_front_addr":"172.21.15.160:6821/369148145","state":["exists","up"]},{"osd":8,"uuid":"02951778-7bd2-4628-a9e2-4029d1d94fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1351316997},{"type":"v1","addr":"172.21.15.204:6817","nonce":1351316997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":1351316997},{"type":"v1","addr":"172.21.15.204:6819","nonce":1351316997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":1351316997},{"type":"v1","addr":"172.21.15.204:6823","nonce":1351316997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":1351316997},{"type":"v1","addr":"172.21.15.204:6821","nonce":1351316997}]},"public_addr":"172.21.15.204:6817/1351316997","cluster_addr":"172.21.15.204:6819/1351316997","heartbeat_back_addr":"172.21.15.204:6823/1351316997","heartbeat_front_addr":"172.21.15.204:6821/1351316997","state":["exists","up"]},{"osd":9,"uuid":"ae93d215-dc45-4916-a42d-72d7da51260c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2119772860},{"type":"v1","addr":"172.21.15.5:6827","nonce":2119772860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2119772860},{"type":"v1","addr":"172.21.15.5:6829","nonce":2119772860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2119772860},{"type":"v1","addr":"172.21.15.5:6833","nonce":2119772860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2119772860},{"type":"v1","addr":"172.21.15.5:6831","nonce":2119772860}]},"public_addr":"172.21.15.5:6827/2119772860","cluster_addr":"172.21.15.5:6829/2119772860","heartbeat_back_addr":"172.21.15.5:6833/2119772860","heartbeat_front_addr":"172.21.15.5:6831/2119772860","state":["exists","up"]},{"osd":10,"uuid":"6c22bfc5-3d41-491a-b862-18ef48485d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4035458661},{"type":"v1","addr":"172.21.15.160:6825","nonce":4035458661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":4035458661},{"type":"v1","addr":"172.21.15.160:6827","nonce":4035458661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":4035458661},{"type":"v1","addr":"172.21.15.160:6831","nonce":4035458661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":4035458661},{"type":"v1","addr":"172.21.15.160:6829","nonce":4035458661}]},"public_addr":"172.21.15.160:6825/4035458661","cluster_addr":"172.21.15.160:6827/4035458661","heartbeat_back_addr":"172.21.15.160:6831/4035458661","heartbeat_front_addr":"172.21.15.160:6829/4035458661","state":["exists","up"]},{"osd":11,"uuid":"f7b11c08-6aaa-4c9c-bf3e-794e0ed6a48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":1270764757},{"type":"v1","addr":"172.21.15.204:6825","nonce":1270764757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":1270764757},{"type":"v1","addr":"172.21.15.204:6827","nonce":1270764757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":1270764757},{"type":"v1","addr":"172.21.15.204:6831","nonce":1270764757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":1270764757},{"type":"v1","addr":"172.21.15.204:6829","nonce":1270764757}]},"public_addr":"172.21.15.204:6825/1270764757","cluster_addr":"172.21.15.204:6827/1270764757","heartbeat_back_addr":"172.21.15.204:6831/1270764757","heartbeat_front_addr":"172.21.15.204:6829/1270764757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:35:30.487540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:35:51.102011+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:36:13.732852+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:36:35.091981+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:36:55.969859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:37:19.104930+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:37:40.814117+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:38:01.341317+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:38:24.655220+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:38:46.055116+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:39:06.708244+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:39:29.705438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/2286807214":"2024-01-25T15:34:07.143709+0000","172.21.15.5:0/335989886":"2024-01-25T15:34:07.143709+0000","172.21.15.5:0/3245435659":"2024-01-25T15:33:43.447232+0000","172.21.15.5:6800/1174207089":"2024-01-25T15:33:43.447232+0000","172.21.15.5:6800/2286807214":"2024-01-25T15:34:07.143709+0000","172.21.15.5:0/1119155546":"2024-01-25T15:34:07.143709+0000","172.21.15.5:0/1582462061":"2024-01-25T15:33:43.447232+0000","172.21.15.5:0/815108608":"2024-01-25T15:33:43.447232+0000","172.21.15.5:6801/1174207089":"2024-01-25T15:33:43.447232+0000","172.21.15.5:0/3735059725":"2024-01-25T15:34:07.143709+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T15:40:18.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.029+0000 7fd9a8600700 1 -- 172.21.15.5:0/3102280231 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fd9800a05f0 msgr2=0x7fd9800a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:18.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.029+0000 7fd9a8600700 1 --2- 172.21.15.5:0/3102280231 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fd9800a05f0 0x7fd9800a2ab0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd990005d90 tx=0x7fd990005d20 comp rx=0 tx=0).stop 2024-01-24T15:40:18.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.029+0000 7fd9a8600700 1 -- 172.21.15.5:0/3102280231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9a01040d0 msgr2=0x7fd9a0199110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:18.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.029+0000 7fd9a8600700 1 --2- 172.21.15.5:0/3102280231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9a01040d0 0x7fd9a0199110 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd98800e9a0 tx=0x7fd98800ed60 comp rx=0 tx=0).stop 2024-01-24T15:40:18.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.029+0000 7fd9a8600700 1 -- 172.21.15.5:0/3102280231 shutdown_connections 2024-01-24T15:40:18.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.029+0000 7fd9a8600700 1 --2- 172.21.15.5:0/3102280231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9a0106a00 0x7fd9a01a0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:18.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.029+0000 7fd9a8600700 1 --2- 172.21.15.5:0/3102280231 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fd9a01017a0 0x7fd9a0198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:18.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.029+0000 7fd9a8600700 1 --2- 172.21.15.5:0/3102280231 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fd9800a05f0 0x7fd9800a2ab0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:18.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.029+0000 7fd9a8600700 1 --2- 172.21.15.5:0/3102280231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd9a01040d0 0x7fd9a0199110 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:18.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.029+0000 7fd9a8600700 1 -- 172.21.15.5:0/3102280231 >> 172.21.15.5:0/3102280231 conn(0x7fd9a00fb170 msgr2=0x7fd9a0102410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:18.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.029+0000 7fd9a8600700 1 -- 172.21.15.5:0/3102280231 shutdown_connections 2024-01-24T15:40:18.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.029+0000 7fd9a8600700 1 -- 172.21.15.5:0/3102280231 wait complete. 2024-01-24T15:40:18.050 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-24T15:40:18.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.246+0000 7f0fe3e00700 1 -- 172.21.15.5:0/1031267802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fdc101840 msgr2=0x7f0fdc103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:18.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.246+0000 7f0fe3e00700 1 --2- 172.21.15.5:0/1031267802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fdc101840 0x7f0fdc103c30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc009990 tx=0x7f0fcc009ca0 comp rx=0 tx=0).stop 2024-01-24T15:40:18.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.246+0000 7f0fe3e00700 1 -- 172.21.15.5:0/1031267802 shutdown_connections 2024-01-24T15:40:18.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.246+0000 7f0fe3e00700 1 --2- 172.21.15.5:0/1031267802 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fdc106aa0 0x7f0fdc108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:18.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.246+0000 7f0fe3e00700 1 --2- 172.21.15.5:0/1031267802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fdc101840 0x7f0fdc103c30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:18.249 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.246+0000 7f0fe3e00700 1 --2- 172.21.15.5:0/1031267802 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0fdc104170 0x7f0fdc106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:18.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.246+0000 7f0fe3e00700 1 -- 172.21.15.5:0/1031267802 >> 172.21.15.5:0/1031267802 conn(0x7f0fdc0fb170 msgr2=0x7f0fdc0fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:18.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.246+0000 7f0fe3e00700 1 -- 172.21.15.5:0/1031267802 shutdown_connections 2024-01-24T15:40:18.250 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.246+0000 7f0fe3e00700 1 -- 172.21.15.5:0/1031267802 wait complete. 2024-01-24T15:40:18.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.247+0000 7f0fe3e00700 1 Processor -- start 2024-01-24T15:40:18.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.248+0000 7f0fe3e00700 1 -- start start 2024-01-24T15:40:18.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.248+0000 7f0fe3e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fdc101840 0x7f0fdc1968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:18.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.248+0000 7f0fe3e00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0fdc104170 0x7f0fdc196df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:18.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.248+0000 7f0fe3e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fdc106aa0 0x7f0fdc19de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:18.252 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.248+0000 7f0fe3e00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc19e430 con 0x7f0fdc101840 2024-01-24T15:40:18.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.248+0000 7f0fe3e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc19e570 con 0x7f0fdc106aa0 2024-01-24T15:40:18.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.248+0000 7f0fe3e00700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc19e700 con 0x7f0fdc104170 2024-01-24T15:40:18.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.248+0000 7f0fe1400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fdc101840 0x7f0fdc1968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:18.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.248+0000 7f0fe1400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fdc101840 0x7f0fdc1968b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50368/0 (socket says 172.21.15.5:50368) 2024-01-24T15:40:18.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.248+0000 7f0fe1400700 1 -- 172.21.15.5:0/3384407490 learned_addr learned my addr 172.21.15.5:0/3384407490 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:40:18.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.248+0000 7f0fe1e00700 1 --2- 172.21.15.5:0/3384407490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fdc106aa0 0x7f0fdc19de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:18.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.248+0000 7f0fe0a00700 1 --2- 172.21.15.5:0/3384407490 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0fdc104170 0x7f0fdc196df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:18.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.249+0000 7f0fe1400700 1 -- 172.21.15.5:0/3384407490 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0fdc104170 msgr2=0x7f0fdc196df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:18.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.249+0000 7f0fe1400700 1 --2- 172.21.15.5:0/3384407490 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0fdc104170 0x7f0fdc196df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:18.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.249+0000 7f0fe1400700 1 -- 172.21.15.5:0/3384407490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fdc106aa0 msgr2=0x7f0fdc19de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:18.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.249+0000 7f0fe1400700 1 --2- 172.21.15.5:0/3384407490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fdc106aa0 0x7f0fdc19de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:18.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.249+0000 7f0fe1400700 1 -- 172.21.15.5:0/3384407490 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fcc0095f0 con 0x7f0fdc101840 2024-01-24T15:40:18.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.249+0000 7f0fe0a00700 1 --2- 172.21.15.5:0/3384407490 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0fdc104170 0x7f0fdc196df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T15:40:18.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.249+0000 7f0fe1400700 1 --2- 172.21.15.5:0/3384407490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fdc101840 0x7f0fdc1968b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc00c010 tx=0x7f0fcc003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:18.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.249+0000 7f0fda000700 1 -- 172.21.15.5:0/3384407490 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc01d070 con 0x7f0fdc101840 2024-01-24T15:40:18.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.249+0000 7f0fda000700 1 -- 172.21.15.5:0/3384407490 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0fcc0041d0 con 0x7f0fdc101840 2024-01-24T15:40:18.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.249+0000 7f0fe3e00700 1 -- 172.21.15.5:0/3384407490 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fdc19e980 con 0x7f0fdc101840 2024-01-24T15:40:18.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.249+0000 7f0fda000700 1 -- 172.21.15.5:0/3384407490 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc00f460 con 0x7f0fdc101840 2024-01-24T15:40:18.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.249+0000 7f0fe3e00700 1 -- 172.21.15.5:0/3384407490 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fdc19ee00 con 0x7f0fdc101840 2024-01-24T15:40:18.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.250+0000 7f0fe3e00700 1 -- 172.21.15.5:0/3384407490 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fdc0fccf0 con 0x7f0fdc101840 2024-01-24T15:40:18.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.252+0000 7f0fda000700 1 -- 172.21.15.5:0/3384407490 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f0fcc022670 con 0x7f0fdc101840 2024-01-24T15:40:18.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.253+0000 7f0fda000700 1 --2- 172.21.15.5:0/3384407490 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f0fbc0a05f0 0x7f0fbc0a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:18.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.254+0000 7f0fda000700 1 -- 172.21.15.5:0/3384407490 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0fcc0cd3a0 con 0x7f0fdc101840 2024-01-24T15:40:18.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.254+0000 7f0fe0a00700 1 --2- 172.21.15.5:0/3384407490 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f0fbc0a05f0 0x7f0fbc0a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:18.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.254+0000 7f0fe0a00700 1 --2- 172.21.15.5:0/3384407490 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f0fbc0a05f0 0x7f0fbc0a2ab0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4005fd0 tx=0x7f0fc4005dc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:18.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.256+0000 7f0fda000700 1 -- 172.21.15.5:0/3384407490 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f0fcc097080 con 0x7f0fdc101840 2024-01-24T15:40:18.432 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:18 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/2079192212' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-01-24T15:40:18.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:18 smithi005 ceph-mon[35346]: osdmap e80: 12 total, 12 up, 12 in 2024-01-24T15:40:18.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:18 smithi005 ceph-mon[35346]: pgmap v255: 97 pgs: 8 creating+peering, 1 active+clean, 88 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:18.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:18 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/3983849894' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-01-24T15:40:18.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:18 smithi005 ceph-mon[35346]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-01-24T15:40:18.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:18 smithi005 ceph-mon[35346]: osdmap e81: 12 total, 12 up, 12 in 2024-01-24T15:40:18.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:18 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/3983849894' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-01-24T15:40:18.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:18 smithi005 ceph-mon[35346]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-01-24T15:40:18.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:18 smithi005 ceph-mon[35346]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-01-24T15:40:18.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:18 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/3102280231' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-24T15:40:18.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.469+0000 7f0fe3e00700 1 -- 172.21.15.5:0/3384407490 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fdc02cc70 con 0x7f0fdc101840 2024-01-24T15:40:18.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.471+0000 7f0fda000700 1 -- 172.21.15.5:0/3384407490 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22086 (secure 0 0 0) 0x7f0fcc027090 con 0x7f0fdc101840 2024-01-24T15:40:18.473 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-01-24T15:40:18.474 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":81,"fsid":"bede0bb6-bacd-11ee-95b1-87774f69a715","created":"2024-01-24T15:33:13.568798+0000","modified":"2024-01-24T15:40:17.559911+0000","last_up_change":"2024-01-24T15:39:31.302244+0000","last_in_change":"2024-01-24T15:39:11.995261+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-24T15:36:17.760558+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-24T15:40:15.652636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-24T15:40:17.041082+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"caab3496-5d11-4c8e-bd4f-ca7cdb6924a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3395335330},{"type":"v1","addr":"172.21.15.5:6803","nonce":3395335330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3395335330},{"type":"v1","addr":"172.21.15.5:6805","nonce":3395335330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3395335330},{"type":"v1","addr":"172.21.15.5:6809","nonce":3395335330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3395335330},{"type":"v1","addr":"172.21.15.5:6807","nonce":3395335330}]},"public_addr":"172.21.15.5:6803/3395335330","cluster_addr":"172.21.15.5:6805/3395335330","heartbeat_back_addr":"172.21.15.5:6809/3395335330","heartbeat_front_addr":"172.21.15.5:6807/3395335330","state":["exists","up"]},{"osd":1,"uuid":"547ee262-816e-46ee-b4d4-8dd267abb2de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1386884060},{"type":"v1","addr":"172.21.15.160:6801","nonce":1386884060}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":1386884060},{"type":"v1","addr":"172.21.15.160:6803","nonce":1386884060}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":1386884060},{"type":"v1","addr":"172.21.15.160:6807","nonce":1386884060}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":1386884060},{"type":"v1","addr":"172.21.15.160:6805","nonce":1386884060}]},"public_addr":"172.21.15.160:6801/1386884060","cluster_addr":"172.21.15.160:6803/1386884060","heartbeat_back_addr":"172.21.15.160:6807/1386884060","heartbeat_front_addr":"172.21.15.160:6805/1386884060","state":["exists","up"]},{"osd":2,"uuid":"b07d96ff-9584-4e71-a846-e8b939918708","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6800","nonce":1780238382},{"type":"v1","addr":"172.21.15.204:6801","nonce":1780238382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6802","nonce":1780238382},{"type":"v1","addr":"172.21.15.204:6803","nonce":1780238382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6806","nonce":1780238382},{"type":"v1","addr":"172.21.15.204:6807","nonce":1780238382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6804","nonce":1780238382},{"type":"v1","addr":"172.21.15.204:6805","nonce":1780238382}]},"public_addr":"172.21.15.204:6801/1780238382","cluster_addr":"172.21.15.204:6803/1780238382","heartbeat_back_addr":"172.21.15.204:6807/1780238382","heartbeat_front_addr":"172.21.15.204:6805/1780238382","state":["exists","up"]},{"osd":3,"uuid":"4a086309-5d6b-4226-93d0-e3e55ced7172","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2647874051},{"type":"v1","addr":"172.21.15.5:6811","nonce":2647874051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2647874051},{"type":"v1","addr":"172.21.15.5:6813","nonce":2647874051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2647874051},{"type":"v1","addr":"172.21.15.5:6817","nonce":2647874051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2647874051},{"type":"v1","addr":"172.21.15.5:6815","nonce":2647874051}]},"public_addr":"172.21.15.5:6811/2647874051","cluster_addr":"172.21.15.5:6813/2647874051","heartbeat_back_addr":"172.21.15.5:6817/2647874051","heartbeat_front_addr":"172.21.15.5:6815/2647874051","state":["exists","up"]},{"osd":4,"uuid":"27d27d11-ef97-4faf-b5fb-c744bbdbcf9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4260815326},{"type":"v1","addr":"172.21.15.160:6809","nonce":4260815326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4260815326},{"type":"v1","addr":"172.21.15.160:6811","nonce":4260815326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4260815326},{"type":"v1","addr":"172.21.15.160:6815","nonce":4260815326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4260815326},{"type":"v1","addr":"172.21.15.160:6813","nonce":4260815326}]},"public_addr":"172.21.15.160:6809/4260815326","cluster_addr":"172.21.15.160:6811/4260815326","heartbeat_back_addr":"172.21.15.160:6815/4260815326","heartbeat_front_addr":"172.21.15.160:6813/4260815326","state":["exists","up"]},{"osd":5,"uuid":"12425c52-d7ae-46f9-a949-c089587b3ffd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6808","nonce":1024339043},{"type":"v1","addr":"172.21.15.204:6809","nonce":1024339043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6810","nonce":1024339043},{"type":"v1","addr":"172.21.15.204:6811","nonce":1024339043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6814","nonce":1024339043},{"type":"v1","addr":"172.21.15.204:6815","nonce":1024339043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6812","nonce":1024339043},{"type":"v1","addr":"172.21.15.204:6813","nonce":1024339043}]},"public_addr":"172.21.15.204:6809/1024339043","cluster_addr":"172.21.15.204:6811/1024339043","heartbeat_back_addr":"172.21.15.204:6815/1024339043","heartbeat_front_addr":"172.21.15.204:6813/1024339043","state":["exists","up"]},{"osd":6,"uuid":"2dda7ced-0f36-4f9e-aa2c-3d2d03990ed7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":754402627},{"type":"v1","addr":"172.21.15.5:6819","nonce":754402627}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":754402627},{"type":"v1","addr":"172.21.15.5:6821","nonce":754402627}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":754402627},{"type":"v1","addr":"172.21.15.5:6825","nonce":754402627}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":754402627},{"type":"v1","addr":"172.21.15.5:6823","nonce":754402627}]},"public_addr":"172.21.15.5:6819/754402627","cluster_addr":"172.21.15.5:6821/754402627","heartbeat_back_addr":"172.21.15.5:6825/754402627","heartbeat_front_addr":"172.21.15.5:6823/754402627","state":["exists","up"]},{"osd":7,"uuid":"cafcc179-ee88-44b5-a3b0-e8d772bf8ac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":369148145},{"type":"v1","addr":"172.21.15.160:6817","nonce":369148145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":369148145},{"type":"v1","addr":"172.21.15.160:6819","nonce":369148145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":369148145},{"type":"v1","addr":"172.21.15.160:6823","nonce":369148145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":369148145},{"type":"v1","addr":"172.21.15.160:6821","nonce":369148145}]},"public_addr":"172.21.15.160:6817/369148145","cluster_addr":"172.21.15.160:6819/369148145","heartbeat_back_addr":"172.21.15.160:6823/369148145","heartbeat_front_addr":"172.21.15.160:6821/369148145","state":["exists","up"]},{"osd":8,"uuid":"02951778-7bd2-4628-a9e2-4029d1d94fea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6816","nonce":1351316997},{"type":"v1","addr":"172.21.15.204:6817","nonce":1351316997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6818","nonce":1351316997},{"type":"v1","addr":"172.21.15.204:6819","nonce":1351316997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6822","nonce":1351316997},{"type":"v1","addr":"172.21.15.204:6823","nonce":1351316997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6820","nonce":1351316997},{"type":"v1","addr":"172.21.15.204:6821","nonce":1351316997}]},"public_addr":"172.21.15.204:6817/1351316997","cluster_addr":"172.21.15.204:6819/1351316997","heartbeat_back_addr":"172.21.15.204:6823/1351316997","heartbeat_front_addr":"172.21.15.204:6821/1351316997","state":["exists","up"]},{"osd":9,"uuid":"ae93d215-dc45-4916-a42d-72d7da51260c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2119772860},{"type":"v1","addr":"172.21.15.5:6827","nonce":2119772860}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2119772860},{"type":"v1","addr":"172.21.15.5:6829","nonce":2119772860}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":2119772860},{"type":"v1","addr":"172.21.15.5:6833","nonce":2119772860}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2119772860},{"type":"v1","addr":"172.21.15.5:6831","nonce":2119772860}]},"public_addr":"172.21.15.5:6827/2119772860","cluster_addr":"172.21.15.5:6829/2119772860","heartbeat_back_addr":"172.21.15.5:6833/2119772860","heartbeat_front_addr":"172.21.15.5:6831/2119772860","state":["exists","up"]},{"osd":10,"uuid":"6c22bfc5-3d41-491a-b862-18ef48485d36","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4035458661},{"type":"v1","addr":"172.21.15.160:6825","nonce":4035458661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":4035458661},{"type":"v1","addr":"172.21.15.160:6827","nonce":4035458661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":4035458661},{"type":"v1","addr":"172.21.15.160:6831","nonce":4035458661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":4035458661},{"type":"v1","addr":"172.21.15.160:6829","nonce":4035458661}]},"public_addr":"172.21.15.160:6825/4035458661","cluster_addr":"172.21.15.160:6827/4035458661","heartbeat_back_addr":"172.21.15.160:6831/4035458661","heartbeat_front_addr":"172.21.15.160:6829/4035458661","state":["exists","up"]},{"osd":11,"uuid":"f7b11c08-6aaa-4c9c-bf3e-794e0ed6a48b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6824","nonce":1270764757},{"type":"v1","addr":"172.21.15.204:6825","nonce":1270764757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6826","nonce":1270764757},{"type":"v1","addr":"172.21.15.204:6827","nonce":1270764757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6830","nonce":1270764757},{"type":"v1","addr":"172.21.15.204:6831","nonce":1270764757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.204:6828","nonce":1270764757},{"type":"v1","addr":"172.21.15.204:6829","nonce":1270764757}]},"public_addr":"172.21.15.204:6825/1270764757","cluster_addr":"172.21.15.204:6827/1270764757","heartbeat_back_addr":"172.21.15.204:6831/1270764757","heartbeat_front_addr":"172.21.15.204:6829/1270764757","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:35:30.487540+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:35:51.102011+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:36:13.732852+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:36:35.091981+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:36:55.969859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:37:19.104930+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:37:40.814117+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:38:01.341317+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:38:24.655220+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:38:46.055116+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:39:06.708244+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-01-24T15:39:29.705438+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6801/2286807214":"2024-01-25T15:34:07.143709+0000","172.21.15.5:0/335989886":"2024-01-25T15:34:07.143709+0000","172.21.15.5:0/3245435659":"2024-01-25T15:33:43.447232+0000","172.21.15.5:6800/1174207089":"2024-01-25T15:33:43.447232+0000","172.21.15.5:6800/2286807214":"2024-01-25T15:34:07.143709+0000","172.21.15.5:0/1119155546":"2024-01-25T15:34:07.143709+0000","172.21.15.5:0/1582462061":"2024-01-25T15:33:43.447232+0000","172.21.15.5:0/815108608":"2024-01-25T15:33:43.447232+0000","172.21.15.5:6801/1174207089":"2024-01-25T15:33:43.447232+0000","172.21.15.5:0/3735059725":"2024-01-25T15:34:07.143709+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-24T15:40:18.474 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:18 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/2079192212' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-01-24T15:40:18.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:18 smithi204 ceph-mon[39634]: osdmap e80: 12 total, 12 up, 12 in 2024-01-24T15:40:18.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:18 smithi204 ceph-mon[39634]: pgmap v255: 97 pgs: 8 creating+peering, 1 active+clean, 88 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:18.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:18 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/3983849894' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-01-24T15:40:18.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:18 smithi204 ceph-mon[39634]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-01-24T15:40:18.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:18 smithi204 ceph-mon[39634]: osdmap e81: 12 total, 12 up, 12 in 2024-01-24T15:40:18.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:18 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/3983849894' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-01-24T15:40:18.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:18 smithi204 ceph-mon[39634]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-01-24T15:40:18.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:18 smithi204 ceph-mon[39634]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-01-24T15:40:18.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:18 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/3102280231' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-24T15:40:18.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.473+0000 7f0fe3e00700 1 -- 172.21.15.5:0/3384407490 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f0fbc0a05f0 msgr2=0x7f0fbc0a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:18.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.473+0000 7f0fe3e00700 1 --2- 172.21.15.5:0/3384407490 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f0fbc0a05f0 0x7f0fbc0a2ab0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4005fd0 tx=0x7f0fc4005dc0 comp rx=0 tx=0).stop 2024-01-24T15:40:18.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.473+0000 7f0fe3e00700 1 -- 172.21.15.5:0/3384407490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fdc101840 msgr2=0x7f0fdc1968b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:18.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.473+0000 7f0fe3e00700 1 --2- 172.21.15.5:0/3384407490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fdc101840 0x7f0fdc1968b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc00c010 tx=0x7f0fcc003820 comp rx=0 tx=0).stop 2024-01-24T15:40:18.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.473+0000 7f0fe3e00700 1 -- 172.21.15.5:0/3384407490 shutdown_connections 2024-01-24T15:40:18.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.473+0000 7f0fe3e00700 1 --2- 172.21.15.5:0/3384407490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fdc106aa0 0x7f0fdc19de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:18.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.473+0000 7f0fe3e00700 1 --2- 172.21.15.5:0/3384407490 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f0fbc0a05f0 0x7f0fbc0a2ab0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:18.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.473+0000 7f0fe3e00700 1 --2- 172.21.15.5:0/3384407490 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0fdc101840 0x7f0fdc1968b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:18.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.473+0000 7f0fe3e00700 1 --2- 172.21.15.5:0/3384407490 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f0fdc104170 0x7f0fdc196df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:18.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.473+0000 7f0fe3e00700 1 -- 172.21.15.5:0/3384407490 >> 172.21.15.5:0/3384407490 conn(0x7f0fdc0fb170 msgr2=0x7f0fdc1024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:18.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.473+0000 7f0fe3e00700 1 -- 172.21.15.5:0/3384407490 shutdown_connections 2024-01-24T15:40:18.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.473+0000 7f0fe3e00700 1 -- 172.21.15.5:0/3384407490 wait complete. 2024-01-24T15:40:18.495 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-24T15:40:18.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:18 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/2079192212' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-01-24T15:40:18.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:18 smithi160 ceph-mon[38982]: osdmap e80: 12 total, 12 up, 12 in 2024-01-24T15:40:18.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:18 smithi160 ceph-mon[38982]: pgmap v255: 97 pgs: 8 creating+peering, 1 active+clean, 88 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-24T15:40:18.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:18 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/3983849894' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-01-24T15:40:18.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:18 smithi160 ceph-mon[38982]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-01-24T15:40:18.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:18 smithi160 ceph-mon[38982]: osdmap e81: 12 total, 12 up, 12 in 2024-01-24T15:40:18.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:18 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/3983849894' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-01-24T15:40:18.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:18 smithi160 ceph-mon[38982]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-01-24T15:40:18.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:18 smithi160 ceph-mon[38982]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-01-24T15:40:18.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:18 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/3102280231' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-24T15:40:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.694+0000 7f3c52c00700 1 -- 172.21.15.5:0/871752520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c4c1028c0 msgr2=0x7f3c4c109170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.694+0000 7f3c52c00700 1 --2- 172.21.15.5:0/871752520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c4c1028c0 0x7f3c4c109170 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3c4400b0d0 tx=0x7f3c4400b3e0 comp rx=0 tx=0).stop 2024-01-24T15:40:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.694+0000 7f3c52c00700 1 -- 172.21.15.5:0/871752520 shutdown_connections 2024-01-24T15:40:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.694+0000 7f3c52c00700 1 --2- 172.21.15.5:0/871752520 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c4c1028c0 0x7f3c4c109170 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.694+0000 7f3c52c00700 1 --2- 172.21.15.5:0/871752520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c4c100d30 0x7f3c4c101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.694+0000 7f3c52c00700 1 --2- 172.21.15.5:0/871752520 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c4c101f20 0x7f3c4c102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.694+0000 7f3c52c00700 1 -- 172.21.15.5:0/871752520 >> 172.21.15.5:0/871752520 conn(0x7f3c4c0fc280 msgr2=0x7f3c4c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:18.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.694+0000 7f3c52c00700 1 -- 172.21.15.5:0/871752520 shutdown_connections 2024-01-24T15:40:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.694+0000 7f3c52c00700 1 -- 172.21.15.5:0/871752520 wait complete. 2024-01-24T15:40:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.696+0000 7f3c52c00700 1 Processor -- start 2024-01-24T15:40:18.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.696+0000 7f3c52c00700 1 -- start start 2024-01-24T15:40:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.696+0000 7f3c52c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c4c100d30 0x7f3c4c074af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.696+0000 7f3c52c00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c4c101f20 0x7f3c4c073130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.696+0000 7f3c52c00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c4c1028c0 0x7f3c4c073670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.696+0000 7f3c52c00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c073e10 con 0x7f3c4c101f20 2024-01-24T15:40:18.700 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.696+0000 7f3c52c00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c073f80 con 0x7f3c4c100d30 2024-01-24T15:40:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.696+0000 7f3c52c00700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c1a0a30 con 0x7f3c4c1028c0 2024-01-24T15:40:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.697+0000 7f3c4b400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c4c101f20 0x7f3c4c073130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.697+0000 7f3c4b400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c4c101f20 0x7f3c4c073130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50386/0 (socket says 172.21.15.5:50386) 2024-01-24T15:40:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.697+0000 7f3c4b400700 1 -- 172.21.15.5:0/2133153123 learned_addr learned my addr 172.21.15.5:0/2133153123 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:40:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.697+0000 7f3c4be00700 1 --2- 172.21.15.5:0/2133153123 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c4c100d30 0x7f3c4c074af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.697+0000 7f3c50c00700 1 --2- 172.21.15.5:0/2133153123 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c4c1028c0 0x7f3c4c073670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.697+0000 7f3c4b400700 1 -- 172.21.15.5:0/2133153123 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c4c1028c0 msgr2=0x7f3c4c073670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.697+0000 7f3c4b400700 1 --2- 172.21.15.5:0/2133153123 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c4c1028c0 0x7f3c4c073670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.697+0000 7f3c4b400700 1 -- 172.21.15.5:0/2133153123 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c4c100d30 msgr2=0x7f3c4c074af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.697+0000 7f3c4b400700 1 --2- 172.21.15.5:0/2133153123 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c4c100d30 0x7f3c4c074af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.697+0000 7f3c4b400700 1 -- 172.21.15.5:0/2133153123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c44009d00 con 0x7f3c4c101f20 2024-01-24T15:40:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.697+0000 7f3c4be00700 1 --2- 172.21.15.5:0/2133153123 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c4c100d30 0x7f3c4c074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-24T15:40:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.697+0000 7f3c4b400700 1 --2- 172.21.15.5:0/2133153123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c4c101f20 0x7f3c4c073130 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400d950 tx=0x7f3c3400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:18.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.697+0000 7f3c48c00700 1 -- 172.21.15.5:0/2133153123 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34009940 con 0x7f3c4c101f20 2024-01-24T15:40:18.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.698+0000 7f3c48c00700 1 -- 172.21.15.5:0/2133153123 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3c34010460 con 0x7f3c4c101f20 2024-01-24T15:40:18.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.698+0000 7f3c52c00700 1 -- 172.21.15.5:0/2133153123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4c1a0d10 con 0x7f3c4c101f20 2024-01-24T15:40:18.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.698+0000 7f3c48c00700 1 -- 172.21.15.5:0/2133153123 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3400f620 con 0x7f3c4c101f20 2024-01-24T15:40:18.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.698+0000 7f3c52c00700 1 -- 172.21.15.5:0/2133153123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4c1a11d0 con 0x7f3c4c101f20 2024-01-24T15:40:18.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.699+0000 7f3c52c00700 1 -- 172.21.15.5:0/2133153123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4c10c450 con 0x7f3c4c101f20 2024-01-24T15:40:18.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.701+0000 7f3c48c00700 1 -- 172.21.15.5:0/2133153123 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f3c340105d0 con 0x7f3c4c101f20 2024-01-24T15:40:18.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.702+0000 7f3c48c00700 1 --2- 172.21.15.5:0/2133153123 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f3c2c0a0520 0x7f3c2c0a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:18.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.703+0000 7f3c48c00700 1 -- 172.21.15.5:0/2133153123 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3c340cb720 con 0x7f3c4c101f20 2024-01-24T15:40:18.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.703+0000 7f3c4be00700 1 --2- 172.21.15.5:0/2133153123 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f3c2c0a0520 0x7f3c2c0a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:18.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.703+0000 7f3c4be00700 1 --2- 172.21.15.5:0/2133153123 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f3c2c0a0520 0x7f3c2c0a29e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c101d80 tx=0x7f3c3c00a680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:18.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.705+0000 7f3c48c00700 1 -- 172.21.15.5:0/2133153123 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f3c34095370 con 0x7f3c4c101f20 2024-01-24T15:40:18.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:18.966+0000 7f3c52c00700 1 -- 172.21.15.5:0/2133153123 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3c4c10c640 con 0x7f3c4c101f20 2024-01-24T15:40:19.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:19 smithi005 ceph-mon[35346]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-24T15:40:19.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:19 smithi005 ceph-mon[35346]: mds.? [v2:172.21.15.160:6838/3540787202,v1:172.21.15.160:6839/3540787202] up:active 2024-01-24T15:40:19.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:19 smithi005 ceph-mon[35346]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-01-24T15:40:19.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:19 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/3384407490' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-24T15:40:19.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:19 smithi005 ceph-mon[35346]: osdmap e82: 12 total, 12 up, 12 in 2024-01-24T15:40:19.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:19 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/2133153123' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-01-24T15:40:19.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:19 smithi204 ceph-mon[39634]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-24T15:40:19.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:19 smithi204 ceph-mon[39634]: mds.? [v2:172.21.15.160:6838/3540787202,v1:172.21.15.160:6839/3540787202] up:active 2024-01-24T15:40:19.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:19 smithi204 ceph-mon[39634]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-01-24T15:40:19.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:19 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/3384407490' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-24T15:40:19.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:19 smithi204 ceph-mon[39634]: osdmap e82: 12 total, 12 up, 12 in 2024-01-24T15:40:19.475 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:19 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/2133153123' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-01-24T15:40:19.506 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:19 smithi160 ceph-mon[38982]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-24T15:40:19.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:19 smithi160 ceph-mon[38982]: mds.? [v2:172.21.15.160:6838/3540787202,v1:172.21.15.160:6839/3540787202] up:active 2024-01-24T15:40:19.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:19 smithi160 ceph-mon[38982]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-01-24T15:40:19.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:19 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/3384407490' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-24T15:40:19.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:19 smithi160 ceph-mon[38982]: osdmap e82: 12 total, 12 up, 12 in 2024-01-24T15:40:19.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:19 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/2133153123' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-01-24T15:40:19.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.568+0000 7f3c48c00700 1 -- 172.21.15.5:0/2133153123 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3c340160b0 con 0x7f3c4c101f20 2024-01-24T15:40:19.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.571+0000 7f3c52c00700 1 -- 172.21.15.5:0/2133153123 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f3c2c0a0520 msgr2=0x7f3c2c0a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:19.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.571+0000 7f3c52c00700 1 --2- 172.21.15.5:0/2133153123 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f3c2c0a0520 0x7f3c2c0a29e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c101d80 tx=0x7f3c3c00a680 comp rx=0 tx=0).stop 2024-01-24T15:40:19.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.571+0000 7f3c52c00700 1 -- 172.21.15.5:0/2133153123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c4c101f20 msgr2=0x7f3c4c073130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:19.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.571+0000 7f3c52c00700 1 --2- 172.21.15.5:0/2133153123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c4c101f20 0x7f3c4c073130 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3c3400d950 tx=0x7f3c3400dc60 comp rx=0 tx=0).stop 2024-01-24T15:40:19.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.571+0000 7f3c52c00700 1 -- 172.21.15.5:0/2133153123 shutdown_connections 2024-01-24T15:40:19.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.571+0000 7f3c52c00700 1 --2- 172.21.15.5:0/2133153123 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f3c4c1028c0 0x7f3c4c073670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:19.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.571+0000 7f3c52c00700 1 --2- 172.21.15.5:0/2133153123 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c4c100d30 0x7f3c4c074af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.571+0000 7f3c52c00700 1 --2- 172.21.15.5:0/2133153123 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f3c2c0a0520 0x7f3c2c0a29e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.571+0000 7f3c52c00700 1 --2- 172.21.15.5:0/2133153123 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c4c101f20 0x7f3c4c073130 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.571+0000 7f3c52c00700 1 -- 172.21.15.5:0/2133153123 >> 172.21.15.5:0/2133153123 conn(0x7f3c4c0fc280 msgr2=0x7f3c4c0fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.571+0000 7f3c52c00700 1 -- 172.21.15.5:0/2133153123 shutdown_connections 2024-01-24T15:40:19.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.571+0000 7f3c52c00700 1 -- 172.21.15.5:0/2133153123 wait complete. 2024-01-24T15:40:19.595 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-01-24T15:40:19.596 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-01-24T15:40:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.800+0000 7fbdea600700 1 -- 172.21.15.5:0/29585654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbde4100d30 msgr2=0x7fbde4101150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.800+0000 7fbdea600700 1 --2- 172.21.15.5:0/29585654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbde4100d30 0x7fbde4101150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40099c0 tx=0x7fbdd4009cd0 comp rx=0 tx=0).stop 2024-01-24T15:40:19.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.800+0000 7fbdea600700 1 -- 172.21.15.5:0/29585654 shutdown_connections 2024-01-24T15:40:19.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.800+0000 7fbdea600700 1 --2- 172.21.15.5:0/29585654 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbde41028c0 0x7fbde4109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:19.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.800+0000 7fbdea600700 1 --2- 172.21.15.5:0/29585654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbde4100d30 0x7fbde4101150 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:19.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.800+0000 7fbdea600700 1 --2- 172.21.15.5:0/29585654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbde4101f20 0x7fbde4102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:19.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.800+0000 7fbdea600700 1 -- 172.21.15.5:0/29585654 >> 172.21.15.5:0/29585654 conn(0x7fbde40fc280 msgr2=0x7fbde40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:19.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.800+0000 7fbdea600700 1 -- 172.21.15.5:0/29585654 shutdown_connections 2024-01-24T15:40:19.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.800+0000 7fbdea600700 1 -- 172.21.15.5:0/29585654 wait complete. 2024-01-24T15:40:19.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.801+0000 7fbdea600700 1 Processor -- start 2024-01-24T15:40:19.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.801+0000 7fbdea600700 1 -- start start 2024-01-24T15:40:19.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.801+0000 7fbdea600700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbde4100d30 0x7fbde4196930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:19.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.801+0000 7fbdea600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbde4101f20 0x7fbde4196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:19.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.801+0000 7fbdea600700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbde41028c0 0x7fbde419dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:19.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.801+0000 7fbdea600700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde419e4b0 con 0x7fbde4100d30 2024-01-24T15:40:19.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.801+0000 7fbdea600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde419e5f0 con 0x7fbde4101f20 2024-01-24T15:40:19.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.801+0000 7fbdea600700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde419e780 con 0x7fbde41028c0 2024-01-24T15:40:19.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.801+0000 7fbde3400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbde4100d30 0x7fbde4196930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:19.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.801+0000 7fbde3400700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbde4100d30 0x7fbde4196930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50408/0 (socket says 172.21.15.5:50408) 2024-01-24T15:40:19.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.801+0000 7fbde3400700 1 -- 172.21.15.5:0/1718312455 learned_addr learned my addr 172.21.15.5:0/1718312455 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:40:19.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.801+0000 7fbde2a00700 1 --2- 172.21.15.5:0/1718312455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbde4101f20 0x7fbde4196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:19.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.801+0000 7fbde3e00700 1 --2- 172.21.15.5:0/1718312455 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbde41028c0 0x7fbde419dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:19.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.801+0000 7fbde3400700 1 -- 172.21.15.5:0/1718312455 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbde41028c0 msgr2=0x7fbde419dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:19.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.801+0000 7fbde3400700 1 --2- 172.21.15.5:0/1718312455 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbde41028c0 0x7fbde419dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:19.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.801+0000 7fbde3400700 1 -- 172.21.15.5:0/1718312455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbde4101f20 msgr2=0x7fbde4196e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:19.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.801+0000 7fbde3400700 1 --2- 172.21.15.5:0/1718312455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbde4101f20 0x7fbde4196e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:19.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.801+0000 7fbde3400700 1 -- 172.21.15.5:0/1718312455 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd40095f0 con 0x7fbde4100d30 2024-01-24T15:40:19.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.803+0000 7fbde3400700 1 --2- 172.21.15.5:0/1718312455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbde4100d30 0x7fbde4196930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4009f50 tx=0x7fbdd4003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:19.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.803+0000 7fbddbe00700 1 -- 172.21.15.5:0/1718312455 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd401d070 con 0x7fbde4100d30 2024-01-24T15:40:19.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.803+0000 7fbddbe00700 1 -- 172.21.15.5:0/1718312455 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbdd400bda0 con 0x7fbde4100d30 2024-01-24T15:40:19.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.803+0000 7fbdea600700 1 -- 172.21.15.5:0/1718312455 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde419ea00 con 0x7fbde4100d30 2024-01-24T15:40:19.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.803+0000 7fbddbe00700 1 -- 172.21.15.5:0/1718312455 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd4022dd0 con 0x7fbde4100d30 2024-01-24T15:40:19.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.803+0000 7fbdea600700 1 -- 172.21.15.5:0/1718312455 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde419ee20 con 0x7fbde4100d30 2024-01-24T15:40:19.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.804+0000 7fbdea600700 1 -- 172.21.15.5:0/1718312455 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde410c440 con 0x7fbde4100d30 2024-01-24T15:40:19.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.806+0000 7fbddbe00700 1 -- 172.21.15.5:0/1718312455 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7fbdd4022570 con 0x7fbde4100d30 2024-01-24T15:40:19.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.807+0000 7fbddbe00700 1 --2- 172.21.15.5:0/1718312455 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fbdc40a0520 0x7fbdc40a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:19.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.807+0000 7fbddbe00700 1 -- 172.21.15.5:0/1718312455 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fbdd40ccc50 con 0x7fbde4100d30 2024-01-24T15:40:19.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.807+0000 7fbde2a00700 1 --2- 172.21.15.5:0/1718312455 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fbdc40a0520 0x7fbdc40a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:19.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.808+0000 7fbde2a00700 1 --2- 172.21.15.5:0/1718312455 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fbdc40a0520 0x7fbdc40a29e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc005950 tx=0x7fbdcc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:19.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:19.810+0000 7fbddbe00700 1 -- 172.21.15.5:0/1718312455 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7fbdd40d2020 con 0x7fbde4100d30 2024-01-24T15:40:20.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:20.072+0000 7fbdea600700 1 -- 172.21.15.5:0/1718312455 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7fbde4107cb0 con 0x7fbde4100d30 2024-01-24T15:40:20.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:20 smithi005 ceph-mon[35346]: pgmap v258: 97 pgs: 6 creating+activating, 19 creating+peering, 63 active+clean, 9 unknown; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 3 op/s 2024-01-24T15:40:20.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:20 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/2133153123' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-01-24T15:40:20.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:20 smithi005 ceph-mon[35346]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-01-24T15:40:20.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:20 smithi005 ceph-mon[35346]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-01-24T15:40:20.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:20 smithi005 ceph-mon[35346]: Cluster is now healthy 2024-01-24T15:40:20.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:20 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/1718312455' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-01-24T15:40:20.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:20 smithi204 ceph-mon[39634]: pgmap v258: 97 pgs: 6 creating+activating, 19 creating+peering, 63 active+clean, 9 unknown; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 3 op/s 2024-01-24T15:40:20.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:20 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/2133153123' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-01-24T15:40:20.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:20 smithi204 ceph-mon[39634]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-01-24T15:40:20.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:20 smithi204 ceph-mon[39634]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-01-24T15:40:20.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:20 smithi204 ceph-mon[39634]: Cluster is now healthy 2024-01-24T15:40:20.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:20 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/1718312455' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-01-24T15:40:21.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:20 smithi160 ceph-mon[38982]: pgmap v258: 97 pgs: 6 creating+activating, 19 creating+peering, 63 active+clean, 9 unknown; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 3 op/s 2024-01-24T15:40:21.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:20 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/2133153123' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-01-24T15:40:21.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:20 smithi160 ceph-mon[38982]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-01-24T15:40:21.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:20 smithi160 ceph-mon[38982]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-01-24T15:40:21.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:20 smithi160 ceph-mon[38982]: Cluster is now healthy 2024-01-24T15:40:21.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:20 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/1718312455' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-01-24T15:40:21.070 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.068+0000 7fbddbe00700 1 -- 172.21.15.5:0/1718312455 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v17) v1 ==== 105+0+0 (secure 0 0 0) 0x7fbdd4027020 con 0x7fbde4100d30 2024-01-24T15:40:21.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.072+0000 7fbdea600700 1 -- 172.21.15.5:0/1718312455 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fbdc40a0520 msgr2=0x7fbdc40a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:21.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.072+0000 7fbdea600700 1 --2- 172.21.15.5:0/1718312455 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fbdc40a0520 0x7fbdc40a29e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc005950 tx=0x7fbdcc00b410 comp rx=0 tx=0).stop 2024-01-24T15:40:21.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.072+0000 7fbdea600700 1 -- 172.21.15.5:0/1718312455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbde4100d30 msgr2=0x7fbde4196930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:21.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.072+0000 7fbdea600700 1 --2- 172.21.15.5:0/1718312455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbde4100d30 0x7fbde4196930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4009f50 tx=0x7fbdd4003a50 comp rx=0 tx=0).stop 2024-01-24T15:40:21.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.072+0000 7fbdea600700 1 -- 172.21.15.5:0/1718312455 shutdown_connections 2024-01-24T15:40:21.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.072+0000 7fbdea600700 1 --2- 172.21.15.5:0/1718312455 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7fbde41028c0 0x7fbde419dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:21.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.072+0000 7fbdea600700 1 --2- 172.21.15.5:0/1718312455 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7fbdc40a0520 0x7fbdc40a29e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.072+0000 7fbdea600700 1 --2- 172.21.15.5:0/1718312455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbde4100d30 0x7fbde4196930 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.072+0000 7fbdea600700 1 --2- 172.21.15.5:0/1718312455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbde4101f20 0x7fbde4196e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.072+0000 7fbdea600700 1 -- 172.21.15.5:0/1718312455 >> 172.21.15.5:0/1718312455 conn(0x7fbde40fc280 msgr2=0x7fbde40fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.073+0000 7fbdea600700 1 -- 172.21.15.5:0/1718312455 shutdown_connections 2024-01-24T15:40:21.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.073+0000 7fbdea600700 1 -- 172.21.15.5:0/1718312455 wait complete. 2024-01-24T15:40:21.103 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-01-24T15:40:21.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.307+0000 7f540be00700 1 -- 172.21.15.5:0/3656640136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54040737a0 msgr2=0x7f5404073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:21.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.307+0000 7f540be00700 1 --2- 172.21.15.5:0/3656640136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54040737a0 0x7f5404073c20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f53ec009990 tx=0x7f53ec009ca0 comp rx=0 tx=0).stop 2024-01-24T15:40:21.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.307+0000 7f540be00700 1 -- 172.21.15.5:0/3656640136 shutdown_connections 2024-01-24T15:40:21.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.307+0000 7f540be00700 1 --2- 172.21.15.5:0/3656640136 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5404108bf0 0x7f540410b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:21.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.307+0000 7f540be00700 1 --2- 172.21.15.5:0/3656640136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5404074d80 0x7f54040731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:21.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.307+0000 7f540be00700 1 --2- 172.21.15.5:0/3656640136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f54040737a0 0x7f5404073c20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:21.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.307+0000 7f540be00700 1 -- 172.21.15.5:0/3656640136 >> 172.21.15.5:0/3656640136 conn(0x7f54040fc280 msgr2=0x7f54040fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:21.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.307+0000 7f540be00700 1 -- 172.21.15.5:0/3656640136 shutdown_connections 2024-01-24T15:40:21.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.307+0000 7f540be00700 1 -- 172.21.15.5:0/3656640136 wait complete. 2024-01-24T15:40:21.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.308+0000 7f540be00700 1 Processor -- start 2024-01-24T15:40:21.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.308+0000 7f540be00700 1 -- start start 2024-01-24T15:40:21.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.308+0000 7f540be00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54040737a0 0x7f5404198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:21.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.309+0000 7f540be00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5404074d80 0x7f5404199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:21.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.309+0000 7f540be00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5404108bf0 0x7f54041a0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:21.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.309+0000 7f540be00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54041a0750 con 0x7f5404108bf0 2024-01-24T15:40:21.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.309+0000 7f540be00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54041a0890 con 0x7f54040737a0 2024-01-24T15:40:21.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.309+0000 7f540be00700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54041a0a20 con 0x7f5404074d80 2024-01-24T15:40:21.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.309+0000 7f5409e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5404108bf0 0x7f54041a0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:21.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.309+0000 7f5409e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5404108bf0 0x7f54041a0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:50426/0 (socket says 172.21.15.5:50426) 2024-01-24T15:40:21.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.309+0000 7f5409e00700 1 -- 172.21.15.5:0/2343224275 learned_addr learned my addr 172.21.15.5:0/2343224275 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:40:21.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.309+0000 7f5408a00700 1 --2- 172.21.15.5:0/2343224275 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5404074d80 0x7f5404199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:21.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.309+0000 7f5409400700 1 --2- 172.21.15.5:0/2343224275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54040737a0 0x7f5404198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:21.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.309+0000 7f5409e00700 1 -- 172.21.15.5:0/2343224275 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5404074d80 msgr2=0x7f5404199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:21.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.309+0000 7f5409e00700 1 --2- 172.21.15.5:0/2343224275 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5404074d80 0x7f5404199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:21.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.309+0000 7f5409e00700 1 -- 172.21.15.5:0/2343224275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54040737a0 msgr2=0x7f5404198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:21.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.309+0000 7f5409e00700 1 --2- 172.21.15.5:0/2343224275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54040737a0 0x7f5404198bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:21.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.309+0000 7f5409e00700 1 -- 172.21.15.5:0/2343224275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec0095f0 con 0x7f5404108bf0 2024-01-24T15:40:21.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.309+0000 7f5409400700 1 --2- 172.21.15.5:0/2343224275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54040737a0 0x7f5404198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-24T15:40:21.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.309+0000 7f5409e00700 1 --2- 172.21.15.5:0/2343224275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5404108bf0 0x7f54041a0180 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f53fc007ee0 tx=0x7f53fc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:21.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.310+0000 7f5402000700 1 -- 172.21.15.5:0/2343224275 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc017070 con 0x7f5404108bf0 2024-01-24T15:40:21.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.310+0000 7f5402000700 1 -- 172.21.15.5:0/2343224275 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f53fc00f040 con 0x7f5404108bf0 2024-01-24T15:40:21.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.310+0000 7f540be00700 1 -- 172.21.15.5:0/2343224275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54041a0d00 con 0x7f5404108bf0 2024-01-24T15:40:21.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.310+0000 7f5402000700 1 -- 172.21.15.5:0/2343224275 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc005710 con 0x7f5404108bf0 2024-01-24T15:40:21.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.310+0000 7f540be00700 1 -- 172.21.15.5:0/2343224275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54041a1200 con 0x7f5404108bf0 2024-01-24T15:40:21.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.311+0000 7f540be00700 1 -- 172.21.15.5:0/2343224275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54041072a0 con 0x7f5404108bf0 2024-01-24T15:40:21.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.313+0000 7f5402000700 1 -- 172.21.15.5:0/2343224275 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f53fc005870 con 0x7f5404108bf0 2024-01-24T15:40:21.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.314+0000 7f5402000700 1 --2- 172.21.15.5:0/2343224275 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f53e40a05a0 0x7f53e40a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:21.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.314+0000 7f5402000700 1 -- 172.21.15.5:0/2343224275 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f53fc0cb040 con 0x7f5404108bf0 2024-01-24T15:40:21.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.314+0000 7f5409400700 1 --2- 172.21.15.5:0/2343224275 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f53e40a05a0 0x7f53e40a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:21.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.315+0000 7f5409400700 1 --2- 172.21.15.5:0/2343224275 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f53e40a05a0 0x7f53e40a2a60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f53f4005fd0 tx=0x7f53f4005ee0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:21.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.318+0000 7f5402000700 1 -- 172.21.15.5:0/2343224275 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f53fc094d30 con 0x7f5404108bf0 2024-01-24T15:40:21.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:21.575+0000 7f540be00700 1 -- 172.21.15.5:0/2343224275 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f540402cc70 con 0x7f5404108bf0 2024-01-24T15:40:21.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:21 smithi005 ceph-mon[35346]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-01-24T15:40:21.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:21 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/1718312455' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-01-24T15:40:21.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:21 smithi005 ceph-mon[35346]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-01-24T15:40:21.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:21 smithi005 ceph-mon[35346]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-01-24T15:40:21.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:21 smithi005 ceph-mon[35346]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-01-24T15:40:21.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:21 smithi005 ceph-mon[35346]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-01-24T15:40:21.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:21 smithi204 ceph-mon[39634]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-01-24T15:40:21.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:21 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/1718312455' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-01-24T15:40:21.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:21 smithi204 ceph-mon[39634]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-01-24T15:40:21.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:21 smithi204 ceph-mon[39634]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-01-24T15:40:21.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:21 smithi204 ceph-mon[39634]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-01-24T15:40:21.976 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:21 smithi204 ceph-mon[39634]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-01-24T15:40:22.007 INFO:journalctl@ceph.mds.b.smithi160.stdout:Jan 24 15:40:21 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-b[75180]: 2024-01-24T15:40:21.608+0000 7fcb42400700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-24T15:40:22.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:21 smithi160 ceph-mon[38982]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-01-24T15:40:22.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:21 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/1718312455' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-01-24T15:40:22.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:21 smithi160 ceph-mon[38982]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-01-24T15:40:22.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:21 smithi160 ceph-mon[38982]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-01-24T15:40:22.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:21 smithi160 ceph-mon[38982]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-01-24T15:40:22.008 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:21 smithi160 ceph-mon[38982]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-01-24T15:40:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.080+0000 7f5402000700 1 -- 172.21.15.5:0/2343224275 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) v1 ==== 121+0+0 (secure 0 0 0) 0x7f53fc098350 con 0x7f5404108bf0 2024-01-24T15:40:22.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.083+0000 7f540be00700 1 -- 172.21.15.5:0/2343224275 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f53e40a05a0 msgr2=0x7f53e40a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:22.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.083+0000 7f540be00700 1 --2- 172.21.15.5:0/2343224275 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f53e40a05a0 0x7f53e40a2a60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f53f4005fd0 tx=0x7f53f4005ee0 comp rx=0 tx=0).stop 2024-01-24T15:40:22.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.083+0000 7f540be00700 1 -- 172.21.15.5:0/2343224275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5404108bf0 msgr2=0x7f54041a0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:22.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.083+0000 7f540be00700 1 --2- 172.21.15.5:0/2343224275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5404108bf0 0x7f54041a0180 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f53fc007ee0 tx=0x7f53fc00d3b0 comp rx=0 tx=0).stop 2024-01-24T15:40:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.083+0000 7f540be00700 1 -- 172.21.15.5:0/2343224275 shutdown_connections 2024-01-24T15:40:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.084+0000 7f540be00700 1 --2- 172.21.15.5:0/2343224275 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f53e40a05a0 0x7f53e40a2a60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.084+0000 7f540be00700 1 --2- 172.21.15.5:0/2343224275 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5404108bf0 0x7f54041a0180 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.084+0000 7f540be00700 1 --2- 172.21.15.5:0/2343224275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54040737a0 0x7f5404198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.084+0000 7f540be00700 1 --2- 172.21.15.5:0/2343224275 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5404074d80 0x7f5404199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.084+0000 7f540be00700 1 -- 172.21.15.5:0/2343224275 >> 172.21.15.5:0/2343224275 conn(0x7f54040fc280 msgr2=0x7f54040fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.084+0000 7f540be00700 1 -- 172.21.15.5:0/2343224275 shutdown_connections 2024-01-24T15:40:22.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.084+0000 7f540be00700 1 -- 172.21.15.5:0/2343224275 wait complete. 2024-01-24T15:40:22.109 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-01-24T15:40:22.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.311+0000 7f5fcae00700 1 -- 172.21.15.5:0/3769053532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fc4100d30 msgr2=0x7f5fc4101150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:22.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.311+0000 7f5fcae00700 1 --2- 172.21.15.5:0/3769053532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fc4100d30 0x7f5fc4101150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5fb40099c0 tx=0x7f5fb4009cd0 comp rx=0 tx=0).stop 2024-01-24T15:40:22.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.311+0000 7f5fcae00700 1 -- 172.21.15.5:0/3769053532 shutdown_connections 2024-01-24T15:40:22.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.311+0000 7f5fcae00700 1 --2- 172.21.15.5:0/3769053532 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fc41028c0 0x7f5fc4109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:22.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.311+0000 7f5fcae00700 1 --2- 172.21.15.5:0/3769053532 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fc4100d30 0x7f5fc4101150 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:22.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.311+0000 7f5fcae00700 1 --2- 172.21.15.5:0/3769053532 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fc4101f20 0x7f5fc4102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:22.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.311+0000 7f5fcae00700 1 -- 172.21.15.5:0/3769053532 >> 172.21.15.5:0/3769053532 conn(0x7f5fc40fc280 msgr2=0x7f5fc40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:22.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.311+0000 7f5fcae00700 1 -- 172.21.15.5:0/3769053532 shutdown_connections 2024-01-24T15:40:22.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.311+0000 7f5fcae00700 1 -- 172.21.15.5:0/3769053532 wait complete. 2024-01-24T15:40:22.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.312+0000 7f5fcae00700 1 Processor -- start 2024-01-24T15:40:22.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.313+0000 7f5fcae00700 1 -- start start 2024-01-24T15:40:22.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.313+0000 7f5fcae00700 1 --2- >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fc4100d30 0x7f5fc4198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:22.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.313+0000 7f5fcae00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fc4101f20 0x7f5fc4199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:22.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.313+0000 7f5fcae00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fc41028c0 0x7f5fc41a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:22.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.313+0000 7f5fcae00700 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc41a0740 con 0x7f5fc41028c0 2024-01-24T15:40:22.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.313+0000 7f5fcae00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc41a0880 con 0x7f5fc4101f20 2024-01-24T15:40:22.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.313+0000 7f5fcae00700 1 -- --> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc41a0a10 con 0x7f5fc4100d30 2024-01-24T15:40:22.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.313+0000 7f5fc8e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fc41028c0 0x7f5fc41a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:22.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.313+0000 7f5fc8e00700 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fc41028c0 0x7f5fc41a0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:34622/0 (socket says 172.21.15.5:34622) 2024-01-24T15:40:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.313+0000 7f5fc8e00700 1 -- 172.21.15.5:0/652657280 learned_addr learned my addr 172.21.15.5:0/652657280 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-01-24T15:40:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.313+0000 7f5fc3e00700 1 --2- 172.21.15.5:0/652657280 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fc4100d30 0x7f5fc4198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.313+0000 7f5fc3400700 1 --2- 172.21.15.5:0/652657280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fc4101f20 0x7f5fc4199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.314+0000 7f5fc8e00700 1 -- 172.21.15.5:0/652657280 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fc4100d30 msgr2=0x7f5fc4198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.314+0000 7f5fc8e00700 1 --2- 172.21.15.5:0/652657280 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fc4100d30 0x7f5fc4198bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.314+0000 7f5fc8e00700 1 -- 172.21.15.5:0/652657280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fc4101f20 msgr2=0x7f5fc4199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.314+0000 7f5fc8e00700 1 --2- 172.21.15.5:0/652657280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fc4101f20 0x7f5fc4199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.314+0000 7f5fc8e00700 1 -- 172.21.15.5:0/652657280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb40095f0 con 0x7f5fc41028c0 2024-01-24T15:40:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.314+0000 7f5fc8e00700 1 --2- 172.21.15.5:0/652657280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fc41028c0 0x7f5fc41a0170 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc007ee0 tx=0x7f5fbc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.314+0000 7f5fc0c00700 1 -- 172.21.15.5:0/652657280 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc017070 con 0x7f5fc41028c0 2024-01-24T15:40:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.314+0000 7f5fc0c00700 1 -- 172.21.15.5:0/652657280 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fbc00f040 con 0x7f5fc41028c0 2024-01-24T15:40:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.314+0000 7f5fc0c00700 1 -- 172.21.15.5:0/652657280 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc005710 con 0x7f5fc41028c0 2024-01-24T15:40:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.314+0000 7f5fcae00700 1 -- 172.21.15.5:0/652657280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc41a0cf0 con 0x7f5fc41028c0 2024-01-24T15:40:22.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.314+0000 7f5fcae00700 1 -- 172.21.15.5:0/652657280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc41a11b0 con 0x7f5fc41028c0 2024-01-24T15:40:22.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.315+0000 7f5fcae00700 1 -- 172.21.15.5:0/652657280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc4193230 con 0x7f5fc41028c0 2024-01-24T15:40:22.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.318+0000 7f5fc0c00700 1 -- 172.21.15.5:0/652657280 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) v1 ==== 135069+0+0 (secure 0 0 0) 0x7f5fbc005870 con 0x7f5fc41028c0 2024-01-24T15:40:22.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.319+0000 7f5fc0c00700 1 --2- 172.21.15.5:0/652657280 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5fa40a05a0 0x7f5fa40a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-24T15:40:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.319+0000 7f5fc0c00700 1 -- 172.21.15.5:0/652657280 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5fbc0cb040 con 0x7f5fc41028c0 2024-01-24T15:40:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.319+0000 7f5fc3e00700 1 --2- 172.21.15.5:0/652657280 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5fa40a05a0 0x7f5fa40a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-24T15:40:22.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.320+0000 7f5fc3e00700 1 --2- 172.21.15.5:0/652657280 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5fa40a05a0 0x7f5fa40a2a60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4000c00 tx=0x7f5fb4009f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-24T15:40:22.324 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.323+0000 7f5fc0c00700 1 -- 172.21.15.5:0/652657280 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180484 (secure 0 0 0) 0x7f5fbc0fe120 con 0x7f5fc41028c0 2024-01-24T15:40:22.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:22.583+0000 7f5fcae00700 1 -- 172.21.15.5:0/652657280 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f5fc402cc70 con 0x7f5fc41028c0 2024-01-24T15:40:22.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:22 smithi005 ceph-mon[35346]: pgmap v259: 97 pgs: 6 creating+activating, 19 creating+peering, 63 active+clean, 9 unknown; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 790 B/s wr, 2 op/s 2024-01-24T15:40:22.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:22 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/2343224275' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-01-24T15:40:22.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:22 smithi005 ceph-mon[35346]: mds.? [v2:172.21.15.5:6838/1626257631,v1:172.21.15.5:6839/1626257631] up:active 2024-01-24T15:40:22.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:22 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/2343224275' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-01-24T15:40:22.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:22 smithi005 ceph-mon[35346]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-01-24T15:40:22.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:22 smithi005 ceph-mon[35346]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-01-24T15:40:22.933 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:22 smithi005 ceph-mon[35346]: Cluster is now healthy 2024-01-24T15:40:22.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:22 smithi005 ceph-mon[35346]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2024-01-24T15:40:22.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:22 smithi005 ceph-mon[35346]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2024-01-24T15:40:22.934 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:22 smithi005 ceph-mon[35346]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-01-24T15:40:22.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:22 smithi204 ceph-mon[39634]: pgmap v259: 97 pgs: 6 creating+activating, 19 creating+peering, 63 active+clean, 9 unknown; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 790 B/s wr, 2 op/s 2024-01-24T15:40:22.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:22 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/2343224275' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-01-24T15:40:22.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:22 smithi204 ceph-mon[39634]: mds.? [v2:172.21.15.5:6838/1626257631,v1:172.21.15.5:6839/1626257631] up:active 2024-01-24T15:40:22.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:22 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/2343224275' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-01-24T15:40:22.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:22 smithi204 ceph-mon[39634]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-01-24T15:40:22.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:22 smithi204 ceph-mon[39634]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-01-24T15:40:22.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:22 smithi204 ceph-mon[39634]: Cluster is now healthy 2024-01-24T15:40:22.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:22 smithi204 ceph-mon[39634]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2024-01-24T15:40:22.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:22 smithi204 ceph-mon[39634]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2024-01-24T15:40:22.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:22 smithi204 ceph-mon[39634]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-01-24T15:40:23.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:22 smithi160 ceph-mon[38982]: pgmap v259: 97 pgs: 6 creating+activating, 19 creating+peering, 63 active+clean, 9 unknown; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 790 B/s wr, 2 op/s 2024-01-24T15:40:23.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:22 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/2343224275' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-01-24T15:40:23.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:22 smithi160 ceph-mon[38982]: mds.? [v2:172.21.15.5:6838/1626257631,v1:172.21.15.5:6839/1626257631] up:active 2024-01-24T15:40:23.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:22 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/2343224275' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-01-24T15:40:23.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:22 smithi160 ceph-mon[38982]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-01-24T15:40:23.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:22 smithi160 ceph-mon[38982]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-01-24T15:40:23.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:22 smithi160 ceph-mon[38982]: Cluster is now healthy 2024-01-24T15:40:23.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:22 smithi160 ceph-mon[38982]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2024-01-24T15:40:23.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:22 smithi160 ceph-mon[38982]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2024-01-24T15:40:23.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:22 smithi160 ceph-mon[38982]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-01-24T15:40:23.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:23.088+0000 7f5fc0c00700 1 -- 172.21.15.5:0/652657280 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) v1 ==== 115+0+0 (secure 0 0 0) 0x7f5fbc094c90 con 0x7f5fc41028c0 2024-01-24T15:40:23.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:23.092+0000 7f5fcae00700 1 -- 172.21.15.5:0/652657280 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5fa40a05a0 msgr2=0x7f5fa40a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:23.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:23.092+0000 7f5fcae00700 1 --2- 172.21.15.5:0/652657280 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5fa40a05a0 0x7f5fa40a2a60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4000c00 tx=0x7f5fb4009f10 comp rx=0 tx=0).stop 2024-01-24T15:40:23.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:23.092+0000 7f5fcae00700 1 -- 172.21.15.5:0/652657280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fc41028c0 msgr2=0x7f5fc41a0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-24T15:40:23.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:23.092+0000 7f5fcae00700 1 --2- 172.21.15.5:0/652657280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fc41028c0 0x7f5fc41a0170 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc007ee0 tx=0x7f5fbc00d3b0 comp rx=0 tx=0).stop 2024-01-24T15:40:23.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:23.092+0000 7f5fcae00700 1 -- 172.21.15.5:0/652657280 shutdown_connections 2024-01-24T15:40:23.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:23.092+0000 7f5fcae00700 1 --2- 172.21.15.5:0/652657280 >> [v2:172.21.15.5:6800/1971309753,v1:172.21.15.5:6801/1971309753] conn(0x7f5fa40a05a0 0x7f5fa40a2a60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:23.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:23.092+0000 7f5fcae00700 1 --2- 172.21.15.5:0/652657280 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5fc41028c0 0x7f5fc41a0170 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:23.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:23.092+0000 7f5fcae00700 1 --2- 172.21.15.5:0/652657280 >> [v2:172.21.15.204:3300/0,v1:172.21.15.204:6789/0] conn(0x7f5fc4100d30 0x7f5fc4198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:23.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:23.092+0000 7f5fcae00700 1 --2- 172.21.15.5:0/652657280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fc4101f20 0x7f5fc4199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-24T15:40:23.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:23.092+0000 7f5fcae00700 1 -- 172.21.15.5:0/652657280 >> 172.21.15.5:0/652657280 conn(0x7f5fc40fc280 msgr2=0x7f5fc4107900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-24T15:40:23.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:23.092+0000 7f5fcae00700 1 -- 172.21.15.5:0/652657280 shutdown_connections 2024-01-24T15:40:23.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-01-24T15:40:23.092+0000 7f5fcae00700 1 -- 172.21.15.5:0/652657280 wait complete. 2024-01-24T15:40:23.115 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-01-24T15:40:23.115 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks/cephadm.py", line 1051, in cephfs_setup fs = Filesystem(ctx, fs_config=temp, name=name, create=True) File "/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks/cephfs/filesystem.py", line 532, in __init__ self.create() File "/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks/cephfs/filesystem.py", line 762, in create self.run_ceph_cmd('fs', 'subvolumegroup', 'create', self.name, 'qa') AttributeError: 'Filesystem' object has no attribute 'run_ceph_cmd' 2024-01-24T15:40:23.117 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-24T15:40:23.185 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-24T15:40:23.262 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-24T15:40:23.340 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-01-24T15:40:23.341 DEBUG:teuthology.orchestra.run.smithi005:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-01-24T15:40:23.383 DEBUG:teuthology.orchestra.run.smithi160:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-01-24T15:40:23.426 DEBUG:teuthology.orchestra.run.smithi204:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-01-24T15:40:23.470 INFO:tasks.cephadm:Stopping all daemons... 2024-01-24T15:40:23.470 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-01-24T15:40:23.470 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mon.a 2024-01-24T15:40:23.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:23 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/652657280' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-01-24T15:40:23.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:23 smithi204 ceph-mon[39634]: mds.? [v2:172.21.15.204:6838/3704737145,v1:172.21.15.204:6839/3704737145] up:active 2024-01-24T15:40:23.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:23 smithi204 ceph-mon[39634]: from='client.? 172.21.15.5:0/652657280' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-01-24T15:40:23.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:23 smithi204 ceph-mon[39634]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-01-24T15:40:23.725 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:23 smithi204 ceph-mon[39634]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-01-24T15:40:23.830 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:23 smithi005 systemd[1]: Stopping Ceph mon.a for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:40:23.830 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:23 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/652657280' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-01-24T15:40:23.830 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:23 smithi005 ceph-mon[35346]: mds.? [v2:172.21.15.204:6838/3704737145,v1:172.21.15.204:6839/3704737145] up:active 2024-01-24T15:40:23.830 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:23 smithi005 ceph-mon[35346]: from='client.? 172.21.15.5:0/652657280' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-01-24T15:40:23.830 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:23 smithi005 ceph-mon[35346]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-01-24T15:40:23.831 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:23 smithi005 ceph-mon[35346]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-01-24T15:40:24.006 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:23 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/652657280' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-01-24T15:40:24.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:23 smithi160 ceph-mon[38982]: mds.? [v2:172.21.15.204:6838/3704737145,v1:172.21.15.204:6839/3704737145] up:active 2024-01-24T15:40:24.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:23 smithi160 ceph-mon[38982]: from='client.? 172.21.15.5:0/652657280' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-01-24T15:40:24.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:23 smithi160 ceph-mon[38982]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2024-01-24T15:40:24.007 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:23 smithi160 ceph-mon[38982]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-01-24T15:40:24.148 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:23 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mon-a[35323]: 2024-01-24T15:40:23.826+0000 7f2f40e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:40:24.148 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:23 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mon-a[35323]: 2024-01-24T15:40:23.826+0000 7f2f40e00700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-01-24T15:40:24.433 INFO:journalctl@ceph.mon.a.smithi005.stdout:Jan 24 15:40:24 smithi005 bash[87671]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mon-a 2024-01-24T15:40:24.643 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mon.a.service' 2024-01-24T15:40:24.741 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:40:24.741 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-01-24T15:40:24.741 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-01-24T15:40:24.741 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mon.b 2024-01-24T15:40:25.184 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:24 smithi160 systemd[1]: Stopping Ceph mon.b for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:40:25.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:25 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mon-b[38959]: 2024-01-24T15:40:25.181+0000 7f29ca000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:40:25.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:25 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mon-b[38959]: 2024-01-24T15:40:25.181+0000 7f29ca000700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-01-24T15:40:25.507 INFO:journalctl@ceph.mon.b.smithi160.stdout:Jan 24 15:40:25 smithi160 bash[76445]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mon-b 2024-01-24T15:40:25.833 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mon.b.service' 2024-01-24T15:40:25.938 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:40:25.939 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-01-24T15:40:25.939 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-01-24T15:40:25.939 DEBUG:teuthology.orchestra.run.smithi204:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mon.c 2024-01-24T15:40:26.321 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:26 smithi204 systemd[1]: Stopping Ceph mon.c for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:40:26.596 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:26 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mon-c[39598]: 2024-01-24T15:40:26.317+0000 7fc7de400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:40:26.596 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:26 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mon-c[39598]: 2024-01-24T15:40:26.317+0000 7fc7de400700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-01-24T15:40:26.975 INFO:journalctl@ceph.mon.c.smithi204.stdout:Jan 24 15:40:26 smithi204 bash[77576]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mon-c 2024-01-24T15:40:27.153 DEBUG:teuthology.orchestra.run.smithi204:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mon.c.service' 2024-01-24T15:40:27.248 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:40:27.248 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-01-24T15:40:27.249 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-01-24T15:40:27.249 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mgr.x 2024-01-24T15:40:27.629 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:40:27 smithi005 systemd[1]: Stopping Ceph mgr.x for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:40:27.903 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:40:27 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:40:27.625+0000 7f3acdc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:40:27.903 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:40:27 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x[35595]: 2024-01-24T15:40:27.625+0000 7f3acdc00700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-01-24T15:40:28.182 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Jan 24 15:40:27 smithi005 bash[88162]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-x 2024-01-24T15:40:28.276 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mgr.x.service' 2024-01-24T15:40:28.362 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:40:28.362 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-01-24T15:40:28.362 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-01-24T15:40:28.362 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mgr.y 2024-01-24T15:40:28.757 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:40:28 smithi160 systemd[1]: Stopping Ceph mgr.y for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:40:29.256 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:40:28 smithi160 bash[76693]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-y 2024-01-24T15:40:29.257 INFO:journalctl@ceph.mgr.y.smithi160.stdout:Jan 24 15:40:29 smithi160 systemd[1]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-01-24T15:40:29.357 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mgr.y.service' 2024-01-24T15:40:29.438 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:40:29.438 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-01-24T15:40:29.439 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-01-24T15:40:29.439 DEBUG:teuthology.orchestra.run.smithi204:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mgr.z 2024-01-24T15:40:29.975 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:40:29 smithi204 systemd[1]: Stopping Ceph mgr.z for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:40:30.322 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:40:30 smithi204 bash[77736]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mgr-z 2024-01-24T15:40:30.573 INFO:journalctl@ceph.mgr.z.smithi204.stdout:Jan 24 15:40:30 smithi204 systemd[1]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-01-24T15:40:30.584 DEBUG:teuthology.orchestra.run.smithi204:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mgr.z.service' 2024-01-24T15:40:30.669 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:40:30.669 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-01-24T15:40:30.669 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-01-24T15:40:30.669 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.0 2024-01-24T15:40:31.036 INFO:journalctl@ceph.osd.0.smithi005.stdout:Jan 24 15:40:30 smithi005 systemd[1]: Stopping Ceph osd.0 for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:40:31.433 INFO:journalctl@ceph.osd.0.smithi005.stdout:Jan 24 15:40:31 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-0[53422]: 2024-01-24T15:40:31.033+0000 7f211a600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:40:31.433 INFO:journalctl@ceph.osd.0.smithi005.stdout:Jan 24 15:40:31 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-0[53422]: 2024-01-24T15:40:31.033+0000 7f211a600700 -1 osd.0 82 *** Got signal Terminated *** 2024-01-24T15:40:31.433 INFO:journalctl@ceph.osd.0.smithi005.stdout:Jan 24 15:40:31 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-0[53422]: 2024-01-24T15:40:31.033+0000 7f211a600700 -1 osd.0 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-24T15:40:36.936 INFO:journalctl@ceph.osd.0.smithi005.stdout:Jan 24 15:40:36 smithi005 bash[88302]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-0 2024-01-24T15:40:38.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.0.service' 2024-01-24T15:40:38.117 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:40:38.117 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-01-24T15:40:38.118 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-01-24T15:40:38.118 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.1 2024-01-24T15:40:38.482 INFO:journalctl@ceph.osd.1.smithi160.stdout:Jan 24 15:40:38 smithi160 systemd[1]: Stopping Ceph osd.1 for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:40:38.756 INFO:journalctl@ceph.osd.1.smithi160.stdout:Jan 24 15:40:38 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-1[44024]: 2024-01-24T15:40:38.478+0000 7fd9a0e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:40:38.757 INFO:journalctl@ceph.osd.1.smithi160.stdout:Jan 24 15:40:38 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-1[44024]: 2024-01-24T15:40:38.478+0000 7fd9a0e00700 -1 osd.1 82 *** Got signal Terminated *** 2024-01-24T15:40:38.757 INFO:journalctl@ceph.osd.1.smithi160.stdout:Jan 24 15:40:38 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-1[44024]: 2024-01-24T15:40:38.478+0000 7fd9a0e00700 -1 osd.1 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-24T15:40:44.257 INFO:journalctl@ceph.osd.1.smithi160.stdout:Jan 24 15:40:44 smithi160 bash[76845]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-1 2024-01-24T15:40:45.492 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.1.service' 2024-01-24T15:40:45.580 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:40:45.581 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-01-24T15:40:45.581 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-01-24T15:40:45.582 DEBUG:teuthology.orchestra.run.smithi204:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.2 2024-01-24T15:40:45.967 INFO:journalctl@ceph.osd.2.smithi204.stdout:Jan 24 15:40:45 smithi204 systemd[1]: Stopping Ceph osd.2 for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:40:46.225 INFO:journalctl@ceph.osd.2.smithi204.stdout:Jan 24 15:40:45 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-2[45347]: 2024-01-24T15:40:45.964+0000 7fefd8c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:40:46.225 INFO:journalctl@ceph.osd.2.smithi204.stdout:Jan 24 15:40:45 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-2[45347]: 2024-01-24T15:40:45.964+0000 7fefd8c00700 -1 osd.2 82 *** Got signal Terminated *** 2024-01-24T15:40:46.225 INFO:journalctl@ceph.osd.2.smithi204.stdout:Jan 24 15:40:45 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-2[45347]: 2024-01-24T15:40:45.964+0000 7fefd8c00700 -1 osd.2 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-24T15:40:51.975 INFO:journalctl@ceph.osd.2.smithi204.stdout:Jan 24 15:40:51 smithi204 bash[77883]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-2 2024-01-24T15:40:53.427 DEBUG:teuthology.orchestra.run.smithi204:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.2.service' 2024-01-24T15:40:53.513 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:40:53.513 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-01-24T15:40:53.513 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-01-24T15:40:53.513 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.3 2024-01-24T15:40:53.882 INFO:journalctl@ceph.osd.3.smithi005.stdout:Jan 24 15:40:53 smithi005 systemd[1]: Stopping Ceph osd.3 for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:40:54.182 INFO:journalctl@ceph.osd.3.smithi005.stdout:Jan 24 15:40:53 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-3[61955]: 2024-01-24T15:40:53.879+0000 7f5f37c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:40:54.183 INFO:journalctl@ceph.osd.3.smithi005.stdout:Jan 24 15:40:53 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-3[61955]: 2024-01-24T15:40:53.879+0000 7f5f37c00700 -1 osd.3 82 *** Got signal Terminated *** 2024-01-24T15:40:54.183 INFO:journalctl@ceph.osd.3.smithi005.stdout:Jan 24 15:40:53 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-3[61955]: 2024-01-24T15:40:53.879+0000 7f5f37c00700 -1 osd.3 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-24T15:40:57.682 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:40:57 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:40:57.342+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:40:58.682 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:40:58 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:40:58.307+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:40:58.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:40:58 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:40:58.230+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:40:59.460 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:40:59 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:40:59.220+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:40:59.460 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:40:58 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:40:58.990+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:40:59.529 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:40:59 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:40:59.271+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:40:59.724 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:40:59 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:40:59.458+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.837214+0000 front 2024-01-24T15:40:35.836902+0000 (oldest deadline 2024-01-24T15:40:58.737119+0000) 2024-01-24T15:40:59.892 INFO:journalctl@ceph.osd.3.smithi005.stdout:Jan 24 15:40:59 smithi005 bash[88574]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-3 2024-01-24T15:41:00.182 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:40:59 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:40:59.888+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:00.257 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:40:59 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:40:59.980+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:00.682 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:00 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:00.288+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:41:00.725 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:00 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:00.442+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.837214+0000 front 2024-01-24T15:40:35.836902+0000 (oldest deadline 2024-01-24T15:40:58.737119+0000) 2024-01-24T15:41:00.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:00 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:00.256+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:00.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:00 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:00.331+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:01.056 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:00 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:00.933+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:01.082 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.3.service' 2024-01-24T15:41:01.168 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:41:01.169 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-01-24T15:41:01.169 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-01-24T15:41:01.169 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.4 2024-01-24T15:41:01.219 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:00 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:00.961+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:01.432 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:01 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:01.270+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:41:01.474 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:01 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:01.423+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.837214+0000 front 2024-01-24T15:40:35.836902+0000 (oldest deadline 2024-01-24T15:40:58.737119+0000) 2024-01-24T15:41:01.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:01 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:01.218+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:01.507 INFO:journalctl@ceph.osd.4.smithi160.stdout:Jan 24 15:41:01 smithi160 systemd[1]: Stopping Ceph osd.4 for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:41:01.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:01 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:01.316+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:02.007 INFO:journalctl@ceph.osd.4.smithi160.stdout:Jan 24 15:41:01 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-4[51813]: 2024-01-24T15:41:01.524+0000 7fa6a4600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:41:02.007 INFO:journalctl@ceph.osd.4.smithi160.stdout:Jan 24 15:41:01 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-4[51813]: 2024-01-24T15:41:01.524+0000 7fa6a4600700 -1 osd.4 82 *** Got signal Terminated *** 2024-01-24T15:41:02.007 INFO:journalctl@ceph.osd.4.smithi160.stdout:Jan 24 15:41:01 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-4[51813]: 2024-01-24T15:41:01.524+0000 7fa6a4600700 -1 osd.4 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-24T15:41:02.225 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:02 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:02.189+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:02.225 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:01 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:01.958+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:02.317 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:01 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:01.931+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:02.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:02 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:02.315+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:41:02.725 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:02 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:02.415+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.837214+0000 front 2024-01-24T15:40:35.836902+0000 (oldest deadline 2024-01-24T15:40:58.737119+0000) 2024-01-24T15:41:02.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:02 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:02.362+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:03.225 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:03 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:03.173+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:03.225 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:02 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:02.965+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:03.285 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:02 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:02.945+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:03.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:03 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:03.283+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:41:03.725 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:03 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:03.388+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.837214+0000 front 2024-01-24T15:40:35.836902+0000 (oldest deadline 2024-01-24T15:40:58.737119+0000) 2024-01-24T15:41:03.756 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:03 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:03.319+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:04.225 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:04 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:04.175+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:04.225 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:03 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:03.946+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:04.316 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:03 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:03.981+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:04.316 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:03 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:03.981+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:04.682 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:04 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:04.314+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:41:04.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:04 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:04.314+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.936779+0000 front 2024-01-24T15:40:38.936919+0000 (oldest deadline 2024-01-24T15:41:04.236659+0000) 2024-01-24T15:41:04.725 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:04 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:04.438+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.837214+0000 front 2024-01-24T15:40:35.836902+0000 (oldest deadline 2024-01-24T15:40:58.737119+0000) 2024-01-24T15:41:04.725 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:04 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:04.438+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.737770+0000 front 2024-01-24T15:40:38.737745+0000 (oldest deadline 2024-01-24T15:41:04.038022+0000) 2024-01-24T15:41:04.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:04 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:04.368+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:05.181 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:04 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:04.897+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:05.279 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:04 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:04.934+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:05.279 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:04 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:04.934+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:05.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:05 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:05.180+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:05.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:05 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:05.180+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:05.682 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:05 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:05.276+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:41:05.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:05 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:05.276+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.936779+0000 front 2024-01-24T15:40:38.936919+0000 (oldest deadline 2024-01-24T15:41:04.236659+0000) 2024-01-24T15:41:05.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:05 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:05.399+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:05.757 INFO:journalctl@ceph.osd.4.smithi160.stdout:Jan 24 15:41:05 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-4[51813]: 2024-01-24T15:41:05.359+0000 7fa69e000700 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:42.969402+0000 front 2024-01-24T15:40:42.969423+0000 (oldest deadline 2024-01-24T15:41:05.269677+0000) 2024-01-24T15:41:05.902 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:05 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:05.484+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.837214+0000 front 2024-01-24T15:40:35.836902+0000 (oldest deadline 2024-01-24T15:40:58.737119+0000) 2024-01-24T15:41:05.902 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:05 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:05.484+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.737770+0000 front 2024-01-24T15:40:38.737745+0000 (oldest deadline 2024-01-24T15:41:04.038022+0000) 2024-01-24T15:41:06.225 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:06 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:06.138+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:06.225 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:06 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:06.138+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:06.225 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:05 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:05.901+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:06.225 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:05 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:05.901+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:06.270 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:05 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:05.957+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:06.270 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:05 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:05.958+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:06.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:06 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:06.268+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:41:06.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:06 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:06.268+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.936779+0000 front 2024-01-24T15:40:38.936919+0000 (oldest deadline 2024-01-24T15:41:04.236659+0000) 2024-01-24T15:41:06.725 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:06 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:06.443+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.837214+0000 front 2024-01-24T15:40:35.836902+0000 (oldest deadline 2024-01-24T15:40:58.737119+0000) 2024-01-24T15:41:06.725 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:06 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:06.443+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.737770+0000 front 2024-01-24T15:40:38.737745+0000 (oldest deadline 2024-01-24T15:41:04.038022+0000) 2024-01-24T15:41:06.756 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:06 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:06.350+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:06.757 INFO:journalctl@ceph.osd.4.smithi160.stdout:Jan 24 15:41:06 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-4[51813]: 2024-01-24T15:41:06.397+0000 7fa69e000700 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:42.969402+0000 front 2024-01-24T15:40:42.969423+0000 (oldest deadline 2024-01-24T15:41:05.269677+0000) 2024-01-24T15:41:07.087 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:06 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:06.834+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:43.090446+0000 front 2024-01-24T15:40:43.090483+0000 (oldest deadline 2024-01-24T15:41:05.990554+0000) 2024-01-24T15:41:07.088 INFO:journalctl@ceph.osd.4.smithi160.stdout:Jan 24 15:41:07 smithi160 bash[77103]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-4 2024-01-24T15:41:07.183 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:06 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:06.912+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:07.183 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:06 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:06.912+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:07.225 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:07 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:07.129+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:07.225 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:07 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:07.129+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:07.225 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:06 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:06.937+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:07.225 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:06 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:06.937+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:07.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:07 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:07.226+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:41:07.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:07 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:07.226+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.936779+0000 front 2024-01-24T15:40:38.936919+0000 (oldest deadline 2024-01-24T15:41:04.236659+0000) 2024-01-24T15:41:07.724 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:07 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:07.399+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.837214+0000 front 2024-01-24T15:40:35.836902+0000 (oldest deadline 2024-01-24T15:40:58.737119+0000) 2024-01-24T15:41:07.725 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:07 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:07.399+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.737770+0000 front 2024-01-24T15:40:38.737745+0000 (oldest deadline 2024-01-24T15:41:04.038022+0000) 2024-01-24T15:41:07.746 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:07 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:07.307+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:07.746 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:07 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:07.307+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:08.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:07 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:07.877+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:43.090446+0000 front 2024-01-24T15:40:43.090483+0000 (oldest deadline 2024-01-24T15:41:05.990554+0000) 2024-01-24T15:41:08.243 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:07 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:07.933+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:08.243 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:07 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:07.933+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:08.423 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:08 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:08.093+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:08.423 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:08 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:08.093+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:08.424 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:07 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:07.973+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:08.424 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:07 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:07.973+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:08.476 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:08 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:08.300+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:08.476 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:08 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:08.300+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:08.513 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.4.service' 2024-01-24T15:41:08.600 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:41:08.600 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-01-24T15:41:08.600 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-01-24T15:41:08.600 DEBUG:teuthology.orchestra.run.smithi204:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.5 2024-01-24T15:41:08.681 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:08 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:08.422+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.837214+0000 front 2024-01-24T15:40:35.836902+0000 (oldest deadline 2024-01-24T15:40:58.737119+0000) 2024-01-24T15:41:08.681 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:08 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:08.422+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.737770+0000 front 2024-01-24T15:40:38.737745+0000 (oldest deadline 2024-01-24T15:41:04.038022+0000) 2024-01-24T15:41:08.682 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:08 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:08.241+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:41:08.682 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:08 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:08.241+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.936779+0000 front 2024-01-24T15:40:38.936919+0000 (oldest deadline 2024-01-24T15:41:04.236659+0000) 2024-01-24T15:41:08.940 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:08 smithi204 systemd[1]: Stopping Ceph osd.5 for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:41:09.183 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:08 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:08.924+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:09.183 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:08 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:08.924+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:09.225 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:09 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:09.077+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:09.225 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:09 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:09.077+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:09.225 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:08 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:08.937+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:09.225 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:08 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:08.937+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:09.225 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:08 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:08.978+0000 7f7f0a000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:41:09.225 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:08 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:08.978+0000 7f7f0a000700 -1 osd.5 82 *** Got signal Terminated *** 2024-01-24T15:41:09.226 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:08 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:08.978+0000 7f7f0a000700 -1 osd.5 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-24T15:41:09.256 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:08 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:08.897+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:43.090446+0000 front 2024-01-24T15:40:43.090483+0000 (oldest deadline 2024-01-24T15:41:05.990554+0000) 2024-01-24T15:41:09.682 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:09 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:09.256+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:41:09.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:09 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:09.256+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.936779+0000 front 2024-01-24T15:40:38.936919+0000 (oldest deadline 2024-01-24T15:41:04.236659+0000) 2024-01-24T15:41:09.724 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:09 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:09.441+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.837214+0000 front 2024-01-24T15:40:35.836902+0000 (oldest deadline 2024-01-24T15:40:58.737119+0000) 2024-01-24T15:41:09.725 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:09 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:09.441+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.737770+0000 front 2024-01-24T15:40:38.737745+0000 (oldest deadline 2024-01-24T15:41:04.038022+0000) 2024-01-24T15:41:09.756 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:09 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:09.308+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:09.756 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:09 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:09.308+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:10.225 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:10 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:10.126+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:10.225 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:10 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:10.126+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:10.225 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:09 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:09.932+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:10.225 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:09 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:09.932+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:10.256 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:09 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:09.907+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:43.090446+0000 front 2024-01-24T15:40:43.090483+0000 (oldest deadline 2024-01-24T15:41:05.990554+0000) 2024-01-24T15:41:10.283 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:09 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:09.952+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:10.283 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:09 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:09.952+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:10.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:10 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:10.282+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:41:10.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:10 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:10.282+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.936779+0000 front 2024-01-24T15:40:38.936919+0000 (oldest deadline 2024-01-24T15:41:04.236659+0000) 2024-01-24T15:41:10.725 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:10 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:10.461+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.837214+0000 front 2024-01-24T15:40:35.836902+0000 (oldest deadline 2024-01-24T15:40:58.737119+0000) 2024-01-24T15:41:10.725 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:10 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:10.461+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.737770+0000 front 2024-01-24T15:40:38.737745+0000 (oldest deadline 2024-01-24T15:41:04.038022+0000) 2024-01-24T15:41:10.756 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:10 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:10.289+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:10.756 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:10 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:10.289+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:11.224 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:11 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:11.079+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:11.225 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:11 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:11.079+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:11.225 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:10 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:10.969+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:11.225 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:10 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:10.969+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:11.244 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:10 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:10.978+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:11.244 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:10 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:10.978+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:11.256 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:10 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:10.873+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:43.090446+0000 front 2024-01-24T15:40:43.090483+0000 (oldest deadline 2024-01-24T15:41:05.990554+0000) 2024-01-24T15:41:11.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:11 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:11.242+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:41:11.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:11 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:11.242+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.936779+0000 front 2024-01-24T15:40:38.936919+0000 (oldest deadline 2024-01-24T15:41:04.236659+0000) 2024-01-24T15:41:11.725 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:11 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:11.431+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.837214+0000 front 2024-01-24T15:40:35.836902+0000 (oldest deadline 2024-01-24T15:40:58.737119+0000) 2024-01-24T15:41:11.725 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:11 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:11.431+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.737770+0000 front 2024-01-24T15:40:38.737745+0000 (oldest deadline 2024-01-24T15:41:04.038022+0000) 2024-01-24T15:41:11.756 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:11 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:11.313+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:11.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:11 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:11.313+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:12.256 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:11 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:11.898+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:43.090446+0000 front 2024-01-24T15:40:43.090483+0000 (oldest deadline 2024-01-24T15:41:05.990554+0000) 2024-01-24T15:41:12.257 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:11 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:11.898+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.091899+0000 front 2024-01-24T15:40:50.091920+0000 (oldest deadline 2024-01-24T15:41:11.791876+0000) 2024-01-24T15:41:12.263 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:11 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:11.990+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:12.263 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:11 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:11.990+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:12.263 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:11 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:11.990+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:12.418 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:12 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:12.072+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:12.418 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:12 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:12.072+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:12.419 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:12 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:12.017+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:12.419 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:12 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:12.017+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:12.682 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:12 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:12.262+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:41:12.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:12 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:12.262+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.936779+0000 front 2024-01-24T15:40:38.936919+0000 (oldest deadline 2024-01-24T15:41:04.236659+0000) 2024-01-24T15:41:12.725 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:12 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:12.416+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.837214+0000 front 2024-01-24T15:40:35.836902+0000 (oldest deadline 2024-01-24T15:40:58.737119+0000) 2024-01-24T15:41:12.725 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:12 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:12.416+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.737770+0000 front 2024-01-24T15:40:38.737745+0000 (oldest deadline 2024-01-24T15:41:04.038022+0000) 2024-01-24T15:41:12.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:12 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:12.326+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:12.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:12 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:12.326+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:12.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:12 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:12.326+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:13.256 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:12 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:12.851+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:43.090446+0000 front 2024-01-24T15:40:43.090483+0000 (oldest deadline 2024-01-24T15:41:05.990554+0000) 2024-01-24T15:41:13.256 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:12 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:12.851+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.091899+0000 front 2024-01-24T15:40:50.091920+0000 (oldest deadline 2024-01-24T15:41:11.791876+0000) 2024-01-24T15:41:13.275 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:12 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:12.983+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:13.275 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:12 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:12.983+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:13.275 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:12 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:12.983+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:13.371 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:13 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:13.070+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:13.371 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:13 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:13.070+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:13.371 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:13 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:13.070+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:47.346087+0000 front 2024-01-24T15:40:47.346206+0000 (oldest deadline 2024-01-24T15:41:12.646189+0000) 2024-01-24T15:41:13.372 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:13 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:13.056+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:13.372 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:13 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:13.056+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:13.372 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:13 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:13.056+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:13.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:13 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:13.273+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:41:13.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:13 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:13.273+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.936779+0000 front 2024-01-24T15:40:38.936919+0000 (oldest deadline 2024-01-24T15:41:04.236659+0000) 2024-01-24T15:41:13.725 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:13 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:13.369+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.837214+0000 front 2024-01-24T15:40:35.836902+0000 (oldest deadline 2024-01-24T15:40:58.737119+0000) 2024-01-24T15:41:13.725 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:13 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5[53300]: 2024-01-24T15:41:13.369+0000 7f7f01200700 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.737770+0000 front 2024-01-24T15:40:38.737745+0000 (oldest deadline 2024-01-24T15:41:04.038022+0000) 2024-01-24T15:41:13.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:13 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:13.349+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:13.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:13 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:13.349+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:13.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:13 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:13.349+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:14.256 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:13 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:13.838+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:43.090446+0000 front 2024-01-24T15:40:43.090483+0000 (oldest deadline 2024-01-24T15:41:05.990554+0000) 2024-01-24T15:41:14.256 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:13 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:13.838+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.091899+0000 front 2024-01-24T15:40:50.091920+0000 (oldest deadline 2024-01-24T15:41:11.791876+0000) 2024-01-24T15:41:14.308 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:13 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:13.999+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:14.309 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:13 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:13.999+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:14.309 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:13 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:13.999+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:14.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:14 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:14.047+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:14.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:14 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:14.047+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:14.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:14 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:14.047+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:47.346087+0000 front 2024-01-24T15:40:47.346206+0000 (oldest deadline 2024-01-24T15:41:12.646189+0000) 2024-01-24T15:41:14.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:14 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:14.070+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:14.476 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:14 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:14.070+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:14.476 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:14 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:14.070+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:14.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:14 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:14.306+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:41:14.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:14 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:14.306+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.936779+0000 front 2024-01-24T15:40:38.936919+0000 (oldest deadline 2024-01-24T15:41:04.236659+0000) 2024-01-24T15:41:14.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:14 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:14.300+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:14.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:14 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:14.300+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:14.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:14 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:14.300+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:14.975 INFO:journalctl@ceph.osd.5.smithi204.stdout:Jan 24 15:41:14 smithi204 bash[78142]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-5 2024-01-24T15:41:15.257 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:14 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:14.831+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:43.090446+0000 front 2024-01-24T15:40:43.090483+0000 (oldest deadline 2024-01-24T15:41:05.990554+0000) 2024-01-24T15:41:15.257 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:14 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:14.831+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.091899+0000 front 2024-01-24T15:40:50.091920+0000 (oldest deadline 2024-01-24T15:41:11.791876+0000) 2024-01-24T15:41:15.348 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:15 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:15.025+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:15.348 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:15 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:15.025+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:15.348 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:15 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:15.025+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:15.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:15 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:15.001+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:15.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:15 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:15.001+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:15.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:15 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:15.001+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:47.346087+0000 front 2024-01-24T15:40:47.346206+0000 (oldest deadline 2024-01-24T15:41:12.646189+0000) 2024-01-24T15:41:15.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:15 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:15.115+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:15.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:15 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:15.115+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:15.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:15 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:15.115+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:15.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:15 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:15.346+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:41:15.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:15 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:15.346+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.936779+0000 front 2024-01-24T15:40:38.936919+0000 (oldest deadline 2024-01-24T15:41:04.236659+0000) 2024-01-24T15:41:15.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:15 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:15.346+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.138145+0000 front 2024-01-24T15:40:50.138064+0000 (oldest deadline 2024-01-24T15:41:14.837886+0000) 2024-01-24T15:41:15.756 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:15 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:15.284+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:15.756 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:15 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:15.284+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:15.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:15 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:15.284+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:16.205 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:16 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:16.033+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:16.206 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:16 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:16.033+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:16.207 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:16 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:16.033+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:47.346087+0000 front 2024-01-24T15:40:47.346206+0000 (oldest deadline 2024-01-24T15:41:12.646189+0000) 2024-01-24T15:41:16.208 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:16 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:16.097+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:16.208 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:16 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:16.097+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:16.208 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:16 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:16.097+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:16.243 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:15 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:15.821+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:43.090446+0000 front 2024-01-24T15:40:43.090483+0000 (oldest deadline 2024-01-24T15:41:05.990554+0000) 2024-01-24T15:41:16.243 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:15 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:15.821+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.091899+0000 front 2024-01-24T15:40:50.091920+0000 (oldest deadline 2024-01-24T15:41:11.791876+0000) 2024-01-24T15:41:16.304 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:16 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:16.036+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:16.304 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:16 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:16.036+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:16.304 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:16 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:16.036+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:16.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:16 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:16.241+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:16.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:16 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:16.241+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:16.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:16 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:16.241+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:16.518 DEBUG:teuthology.orchestra.run.smithi204:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.5.service' 2024-01-24T15:41:16.603 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:41:16.603 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-01-24T15:41:16.603 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-01-24T15:41:16.603 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.6 2024-01-24T15:41:16.667 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:16 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:16.302+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:41:16.668 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:16 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:16.302+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.936779+0000 front 2024-01-24T15:40:38.936919+0000 (oldest deadline 2024-01-24T15:41:04.236659+0000) 2024-01-24T15:41:16.668 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:16 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:16.302+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.138145+0000 front 2024-01-24T15:40:50.138064+0000 (oldest deadline 2024-01-24T15:41:14.837886+0000) 2024-01-24T15:41:16.932 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:16 smithi005 systemd[1]: Stopping Ceph osd.6 for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:41:17.208 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:16 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:16.817+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:43.090446+0000 front 2024-01-24T15:40:43.090483+0000 (oldest deadline 2024-01-24T15:41:05.990554+0000) 2024-01-24T15:41:17.208 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:16 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:16.817+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.091899+0000 front 2024-01-24T15:40:50.091920+0000 (oldest deadline 2024-01-24T15:41:11.791876+0000) 2024-01-24T15:41:17.278 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:16 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:16.968+0000 7effe4c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:41:17.278 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:16 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:16.968+0000 7effe4c00700 -1 osd.6 82 *** Got signal Terminated *** 2024-01-24T15:41:17.278 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:16 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:16.968+0000 7effe4c00700 -1 osd.6 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-24T15:41:17.278 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:17 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:17.276+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:41:17.278 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:17 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:17.055+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:17.279 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:17 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:17.055+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:17.279 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:17 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:17.055+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:17.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:17 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:17.061+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:17.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:17 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:17.061+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:17.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:17 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:17.061+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:47.346087+0000 front 2024-01-24T15:40:47.346206+0000 (oldest deadline 2024-01-24T15:41:12.646189+0000) 2024-01-24T15:41:17.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:17 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:17.101+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:17.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:17 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:17.101+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:17.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:17 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:17.101+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:17.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:17 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:17.206+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:17.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:17 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:17.206+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:17.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:17 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:17.206+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:17.682 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:17 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:17.276+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.936779+0000 front 2024-01-24T15:40:38.936919+0000 (oldest deadline 2024-01-24T15:41:04.236659+0000) 2024-01-24T15:41:17.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:17 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:17.276+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.138145+0000 front 2024-01-24T15:40:50.138064+0000 (oldest deadline 2024-01-24T15:41:14.837886+0000) 2024-01-24T15:41:18.166 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:17 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:17.788+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:43.090446+0000 front 2024-01-24T15:40:43.090483+0000 (oldest deadline 2024-01-24T15:41:05.990554+0000) 2024-01-24T15:41:18.166 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:17 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:17.788+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.091899+0000 front 2024-01-24T15:40:50.091920+0000 (oldest deadline 2024-01-24T15:41:11.791876+0000) 2024-01-24T15:41:18.433 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:18 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:18.262+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:41:18.433 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:18 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:18.262+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.936779+0000 front 2024-01-24T15:40:38.936919+0000 (oldest deadline 2024-01-24T15:41:04.236659+0000) 2024-01-24T15:41:18.434 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:18 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:18.262+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.138145+0000 front 2024-01-24T15:40:50.138064+0000 (oldest deadline 2024-01-24T15:41:14.837886+0000) 2024-01-24T15:41:18.434 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:18 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:18.019+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:18.434 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:18 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:18.019+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:18.434 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:18 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:18.019+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:18.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:18 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:18.108+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:18.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:18 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:18.108+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:18.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:18 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:18.108+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:47.346087+0000 front 2024-01-24T15:40:47.346206+0000 (oldest deadline 2024-01-24T15:41:12.646189+0000) 2024-01-24T15:41:18.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:18 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:18.088+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:18.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:18 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:18.088+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:18.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:18 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:18.088+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:18.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:18 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:18.163+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:18.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:18 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:18.163+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:18.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:18 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:18.163+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:19.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:18 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:18.746+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:43.090446+0000 front 2024-01-24T15:40:43.090483+0000 (oldest deadline 2024-01-24T15:41:05.990554+0000) 2024-01-24T15:41:19.007 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:18 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:18.746+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.091899+0000 front 2024-01-24T15:40:50.091920+0000 (oldest deadline 2024-01-24T15:41:11.791876+0000) 2024-01-24T15:41:19.433 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:19 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:19.254+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:41:19.433 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:19 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:19.254+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.936779+0000 front 2024-01-24T15:40:38.936919+0000 (oldest deadline 2024-01-24T15:41:04.236659+0000) 2024-01-24T15:41:19.433 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:19 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:19.254+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.138145+0000 front 2024-01-24T15:40:50.138064+0000 (oldest deadline 2024-01-24T15:41:14.837886+0000) 2024-01-24T15:41:19.434 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:19 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:19.015+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:19.434 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:19 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:19.015+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:19.434 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:19 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:19.015+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:19.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:19 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:19.142+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:19.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:19 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:19.142+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:19.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:19 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:19.142+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:47.346087+0000 front 2024-01-24T15:40:47.346206+0000 (oldest deadline 2024-01-24T15:41:12.646189+0000) 2024-01-24T15:41:19.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:19 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:19.044+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:19.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:19 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:19.044+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:19.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:19 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:19.044+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:19.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:19 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:19.207+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:19.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:19 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:19.207+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:19.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:19 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:19.207+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:20.208 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:19 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:19.780+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:43.090446+0000 front 2024-01-24T15:40:43.090483+0000 (oldest deadline 2024-01-24T15:41:05.990554+0000) 2024-01-24T15:41:20.208 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:19 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:19.780+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.091899+0000 front 2024-01-24T15:40:50.091920+0000 (oldest deadline 2024-01-24T15:41:11.791876+0000) 2024-01-24T15:41:20.432 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:20 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:20.285+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:41:20.433 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:20 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:20.285+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.936779+0000 front 2024-01-24T15:40:38.936919+0000 (oldest deadline 2024-01-24T15:41:04.236659+0000) 2024-01-24T15:41:20.433 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:20 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:20.285+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.138145+0000 front 2024-01-24T15:40:50.138064+0000 (oldest deadline 2024-01-24T15:41:14.837886+0000) 2024-01-24T15:41:20.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:20 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:20.037+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:20.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:20 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:20.037+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:20.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:20 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:20.037+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:20.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:20 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:20.167+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:20.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:20 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:20.167+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:20.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:20 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:20.167+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:47.346087+0000 front 2024-01-24T15:40:47.346206+0000 (oldest deadline 2024-01-24T15:41:12.646189+0000) 2024-01-24T15:41:20.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:20 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:20.017+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:20.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:20 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:20.017+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:20.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:20 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:20.017+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:20.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:20 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:20.206+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:20.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:20 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:20.206+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:20.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:20 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:20.206+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:21.217 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:20 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:20.770+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:43.090446+0000 front 2024-01-24T15:40:43.090483+0000 (oldest deadline 2024-01-24T15:41:05.990554+0000) 2024-01-24T15:41:21.217 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:20 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:20.770+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.091899+0000 front 2024-01-24T15:40:50.091920+0000 (oldest deadline 2024-01-24T15:41:11.791876+0000) 2024-01-24T15:41:21.217 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:20 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:20.770+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:55.893133+0000 front 2024-01-24T15:40:55.893228+0000 (oldest deadline 2024-01-24T15:41:19.993296+0000) 2024-01-24T15:41:21.298 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:21 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:21.011+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:21.298 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:21 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:21.011+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:21.298 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:21 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:21.011+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:21.476 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:21 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:21.169+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:21.476 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:21 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:21.169+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:21.477 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:21 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:21.169+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:47.346087+0000 front 2024-01-24T15:40:47.346206+0000 (oldest deadline 2024-01-24T15:41:12.646189+0000) 2024-01-24T15:41:21.477 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:20 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:20.998+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:21.477 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:20 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:20.998+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:21.477 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:20 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:20.998+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:21.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:21 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:21.215+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:21.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:21 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:21.215+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:21.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:21 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:21.215+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:21.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:21 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:21.215+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:21.682 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:21 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:21.296+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.735257+0000 front 2024-01-24T15:40:33.735294+0000 (oldest deadline 2024-01-24T15:40:57.235286+0000) 2024-01-24T15:41:21.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:21 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:21.296+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:38.936779+0000 front 2024-01-24T15:40:38.936919+0000 (oldest deadline 2024-01-24T15:41:04.236659+0000) 2024-01-24T15:41:21.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:21 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:21.296+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.138145+0000 front 2024-01-24T15:40:50.138064+0000 (oldest deadline 2024-01-24T15:41:14.837886+0000) 2024-01-24T15:41:21.683 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:21 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6[69774]: 2024-01-24T15:41:21.296+0000 7effe0400700 -1 osd.6 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.039688+0000 front 2024-01-24T15:40:57.039576+0000 (oldest deadline 2024-01-24T15:41:20.539710+0000) 2024-01-24T15:41:22.007 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:21 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:21.753+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:43.090446+0000 front 2024-01-24T15:40:43.090483+0000 (oldest deadline 2024-01-24T15:41:05.990554+0000) 2024-01-24T15:41:22.007 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:21 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:21.753+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.091899+0000 front 2024-01-24T15:40:50.091920+0000 (oldest deadline 2024-01-24T15:41:11.791876+0000) 2024-01-24T15:41:22.007 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:21 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:21.753+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:55.893133+0000 front 2024-01-24T15:40:55.893228+0000 (oldest deadline 2024-01-24T15:41:19.993296+0000) 2024-01-24T15:41:22.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:22 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:22.037+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:22.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:22 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:22.037+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:22.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:22 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:22.037+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:22.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:22 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:22.192+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:22.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:22 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:22.192+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:22.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:22 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:22.192+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:47.346087+0000 front 2024-01-24T15:40:47.346206+0000 (oldest deadline 2024-01-24T15:41:12.646189+0000) 2024-01-24T15:41:22.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:22 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:22.192+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:58.547328+0000 front 2024-01-24T15:40:58.547353+0000 (oldest deadline 2024-01-24T15:41:21.447398+0000) 2024-01-24T15:41:22.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:21 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:21.986+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:22.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:21 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:21.986+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:22.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:21 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:21.986+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:22.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:22 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:22.205+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:22.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:22 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:22.205+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:22.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:22 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:22.205+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:22.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:22 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:22.205+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:22.932 INFO:journalctl@ceph.osd.6.smithi005.stdout:Jan 24 15:41:22 smithi005 bash[88832]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-6 2024-01-24T15:41:23.191 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:22 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:22.798+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:43.090446+0000 front 2024-01-24T15:40:43.090483+0000 (oldest deadline 2024-01-24T15:41:05.990554+0000) 2024-01-24T15:41:23.191 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:22 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:22.798+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.091899+0000 front 2024-01-24T15:40:50.091920+0000 (oldest deadline 2024-01-24T15:41:11.791876+0000) 2024-01-24T15:41:23.191 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:22 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:22.798+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:55.893133+0000 front 2024-01-24T15:40:55.893228+0000 (oldest deadline 2024-01-24T15:41:19.993296+0000) 2024-01-24T15:41:23.201 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:22 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:22.940+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:23.201 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:22 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:22.940+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:23.202 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:22 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:22.940+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:23.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:23 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:23.070+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:23.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:23 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:23.070+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:23.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:23 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:23.070+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:23.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:23 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:23.070+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:56.753817+0000 front 2024-01-24T15:40:56.753972+0000 (oldest deadline 2024-01-24T15:41:22.654000+0000) 2024-01-24T15:41:23.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:23 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:23.199+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:23.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:23 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:23.199+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:23.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:23 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:23.199+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:47.346087+0000 front 2024-01-24T15:40:47.346206+0000 (oldest deadline 2024-01-24T15:41:12.646189+0000) 2024-01-24T15:41:23.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:23 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:23.199+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:58.547328+0000 front 2024-01-24T15:40:58.547353+0000 (oldest deadline 2024-01-24T15:41:21.447398+0000) 2024-01-24T15:41:23.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:23 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:23.190+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:23.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:23 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:23.190+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:23.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:23 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:23.190+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:23.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:23 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:23.190+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:24.056 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.6.service' 2024-01-24T15:41:24.143 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:41:24.143 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-01-24T15:41:24.143 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-01-24T15:41:24.143 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.7 2024-01-24T15:41:24.169 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:23 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:23.758+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:43.090446+0000 front 2024-01-24T15:40:43.090483+0000 (oldest deadline 2024-01-24T15:41:05.990554+0000) 2024-01-24T15:41:24.170 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:23 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:23.758+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.091899+0000 front 2024-01-24T15:40:50.091920+0000 (oldest deadline 2024-01-24T15:41:11.791876+0000) 2024-01-24T15:41:24.170 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:23 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:23.758+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:55.893133+0000 front 2024-01-24T15:40:55.893228+0000 (oldest deadline 2024-01-24T15:41:19.993296+0000) 2024-01-24T15:41:24.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:24 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:24.053+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:24.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:24 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:24.053+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:24.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:24 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:24.053+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:24.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:24 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:24.053+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:56.753817+0000 front 2024-01-24T15:40:56.753972+0000 (oldest deadline 2024-01-24T15:41:22.654000+0000) 2024-01-24T15:41:24.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:23 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:23.979+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:24.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:23 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:23.979+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:24.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:23 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:23.979+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:24.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:24 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:24.205+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:24.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:24 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:24.205+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:24.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:24 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:24.205+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:47.346087+0000 front 2024-01-24T15:40:47.346206+0000 (oldest deadline 2024-01-24T15:41:12.646189+0000) 2024-01-24T15:41:24.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:24 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:24.205+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:58.547328+0000 front 2024-01-24T15:40:58.547353+0000 (oldest deadline 2024-01-24T15:41:21.447398+0000) 2024-01-24T15:41:24.506 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:24 smithi160 systemd[1]: Stopping Ceph osd.7 for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:41:24.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:24 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:24.168+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:24.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:24 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:24.168+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:24.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:24 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:24.168+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:24.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:24 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:24.168+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:24.784 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:24 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:24.505+0000 7f114c200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:41:24.785 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:24 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:24.505+0000 7f114c200700 -1 osd.7 82 *** Got signal Terminated *** 2024-01-24T15:41:24.785 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:24 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:24.505+0000 7f114c200700 -1 osd.7 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-24T15:41:25.125 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:24 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:24.783+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:43.090446+0000 front 2024-01-24T15:40:43.090483+0000 (oldest deadline 2024-01-24T15:41:05.990554+0000) 2024-01-24T15:41:25.125 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:24 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:24.783+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.091899+0000 front 2024-01-24T15:40:50.091920+0000 (oldest deadline 2024-01-24T15:41:11.791876+0000) 2024-01-24T15:41:25.125 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:24 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:24.783+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:55.893133+0000 front 2024-01-24T15:40:55.893228+0000 (oldest deadline 2024-01-24T15:41:19.993296+0000) 2024-01-24T15:41:25.432 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:25 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:25.070+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:25.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:25 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:25.070+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:25.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:25 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:25.070+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:25.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:25 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:25.070+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:56.753817+0000 front 2024-01-24T15:40:56.753972+0000 (oldest deadline 2024-01-24T15:41:22.654000+0000) 2024-01-24T15:41:25.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:25 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:25.022+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:25.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:25 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:25.022+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:25.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:25 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:25.022+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:25.476 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:25 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:25.253+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:25.476 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:25 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:25.253+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:25.476 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:25 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:25.253+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:47.346087+0000 front 2024-01-24T15:40:47.346206+0000 (oldest deadline 2024-01-24T15:41:12.646189+0000) 2024-01-24T15:41:25.476 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:25 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:25.253+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:58.547328+0000 front 2024-01-24T15:40:58.547353+0000 (oldest deadline 2024-01-24T15:41:21.447398+0000) 2024-01-24T15:41:25.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:25 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:25.123+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:25.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:25 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:25.123+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:25.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:25 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:25.123+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:25.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:25 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:25.123+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:26.096 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:25 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:25.787+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:43.090446+0000 front 2024-01-24T15:40:43.090483+0000 (oldest deadline 2024-01-24T15:41:05.990554+0000) 2024-01-24T15:41:26.096 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:25 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:25.787+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.091899+0000 front 2024-01-24T15:40:50.091920+0000 (oldest deadline 2024-01-24T15:41:11.791876+0000) 2024-01-24T15:41:26.096 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:25 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:25.787+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:55.893133+0000 front 2024-01-24T15:40:55.893228+0000 (oldest deadline 2024-01-24T15:41:19.993296+0000) 2024-01-24T15:41:26.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:26 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:26.056+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:26.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:26 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:26.056+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:26.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:26 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:26.056+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:26.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:26 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:26.056+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:56.753817+0000 front 2024-01-24T15:40:56.753972+0000 (oldest deadline 2024-01-24T15:41:22.654000+0000) 2024-01-24T15:41:26.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:26 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:26.257+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:26.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:26 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:26.257+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:26.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:26 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:26.257+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:47.346087+0000 front 2024-01-24T15:40:47.346206+0000 (oldest deadline 2024-01-24T15:41:12.646189+0000) 2024-01-24T15:41:26.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:26 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:26.257+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:58.547328+0000 front 2024-01-24T15:40:58.547353+0000 (oldest deadline 2024-01-24T15:41:21.447398+0000) 2024-01-24T15:41:26.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:26 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:26.019+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:26.476 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:26 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:26.019+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:26.476 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:26 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:26.019+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:26.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:26 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:26.094+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:26.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:26 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:26.094+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:26.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:26 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:26.094+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:26.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:26 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:26.094+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:27.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:26 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:26.743+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:43.090446+0000 front 2024-01-24T15:40:43.090483+0000 (oldest deadline 2024-01-24T15:41:05.990554+0000) 2024-01-24T15:41:27.007 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:26 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:26.743+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.091899+0000 front 2024-01-24T15:40:50.091920+0000 (oldest deadline 2024-01-24T15:41:11.791876+0000) 2024-01-24T15:41:27.007 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:26 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:26.743+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:55.893133+0000 front 2024-01-24T15:40:55.893228+0000 (oldest deadline 2024-01-24T15:41:19.993296+0000) 2024-01-24T15:41:27.271 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:26 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:26.995+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:27.271 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:26 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:26.995+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:27.272 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:26 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:26.995+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:27.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:27 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:27.051+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:27.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:27 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:27.051+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:27.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:27 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:27.051+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:27.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:27 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:27.051+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:56.753817+0000 front 2024-01-24T15:40:56.753972+0000 (oldest deadline 2024-01-24T15:41:22.654000+0000) 2024-01-24T15:41:27.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:27 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:27.088+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:27.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:27 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:27.088+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:27.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:27 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:27.088+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:27.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:27 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:27.088+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:27.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:27 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:27.269+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:27.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:27 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:27.269+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:27.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:27 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:27.269+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:47.346087+0000 front 2024-01-24T15:40:47.346206+0000 (oldest deadline 2024-01-24T15:41:12.646189+0000) 2024-01-24T15:41:27.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:27 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:27.269+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:58.547328+0000 front 2024-01-24T15:40:58.547353+0000 (oldest deadline 2024-01-24T15:41:21.447398+0000) 2024-01-24T15:41:28.006 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:27 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:27.743+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:43.090446+0000 front 2024-01-24T15:40:43.090483+0000 (oldest deadline 2024-01-24T15:41:05.990554+0000) 2024-01-24T15:41:28.007 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:27 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:27.743+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.091899+0000 front 2024-01-24T15:40:50.091920+0000 (oldest deadline 2024-01-24T15:41:11.791876+0000) 2024-01-24T15:41:28.007 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:27 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:27.743+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:55.893133+0000 front 2024-01-24T15:40:55.893228+0000 (oldest deadline 2024-01-24T15:41:19.993296+0000) 2024-01-24T15:41:28.255 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:27 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:27.992+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:28.255 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:27 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:27.992+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:28.255 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:27 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:27.992+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:28.255 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:27 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:27.992+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:28.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:28 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:28.019+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:28.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:28 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:28.019+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:28.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:28 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:28.019+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:28.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:28 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:28.019+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:56.753817+0000 front 2024-01-24T15:40:56.753972+0000 (oldest deadline 2024-01-24T15:41:22.654000+0000) 2024-01-24T15:41:28.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:28 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:28.106+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:28.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:28 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:28.106+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:28.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:28 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:28.106+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:28.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:28 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:28.106+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:28.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:28 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:28.252+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:28.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:28 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:28.252+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:28.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:28 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:28.252+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:47.346087+0000 front 2024-01-24T15:40:47.346206+0000 (oldest deadline 2024-01-24T15:41:12.646189+0000) 2024-01-24T15:41:28.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:28 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:28.252+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:58.547328+0000 front 2024-01-24T15:40:58.547353+0000 (oldest deadline 2024-01-24T15:41:21.447398+0000) 2024-01-24T15:41:29.063 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:28 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:28.760+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:43.090446+0000 front 2024-01-24T15:40:43.090483+0000 (oldest deadline 2024-01-24T15:41:05.990554+0000) 2024-01-24T15:41:29.063 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:28 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:28.760+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:50.091899+0000 front 2024-01-24T15:40:50.091920+0000 (oldest deadline 2024-01-24T15:41:11.791876+0000) 2024-01-24T15:41:29.063 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:28 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:28.760+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:55.893133+0000 front 2024-01-24T15:40:55.893228+0000 (oldest deadline 2024-01-24T15:41:19.993296+0000) 2024-01-24T15:41:29.063 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:28 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7[60322]: 2024-01-24T15:41:28.760+0000 7f1145c00700 -1 osd.7 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:06.394938+0000 front 2024-01-24T15:41:06.394920+0000 (oldest deadline 2024-01-24T15:41:28.595568+0000) 2024-01-24T15:41:29.225 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:28 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:28.953+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:29.225 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:28 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:28.953+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:29.225 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:28 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:28.953+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:29.225 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:28 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:28.953+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:29.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:29 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:29.040+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:29.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:29 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:29.040+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:29.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:29 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:29.040+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:29.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:29 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:29.040+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:56.753817+0000 front 2024-01-24T15:40:56.753972+0000 (oldest deadline 2024-01-24T15:41:22.654000+0000) 2024-01-24T15:41:29.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:29 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:29.040+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.155111+0000 front 2024-01-24T15:41:03.155071+0000 (oldest deadline 2024-01-24T15:41:28.455072+0000) 2024-01-24T15:41:29.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:29 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:29.061+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:29.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:29 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:29.061+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:29.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:29 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:29.061+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:29.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:29 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:29.061+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:29.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:29 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:29.245+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:29.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:29 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:29.245+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:29.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:29 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:29.245+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:47.346087+0000 front 2024-01-24T15:40:47.346206+0000 (oldest deadline 2024-01-24T15:41:12.646189+0000) 2024-01-24T15:41:29.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:29 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:29.245+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:58.547328+0000 front 2024-01-24T15:40:58.547353+0000 (oldest deadline 2024-01-24T15:41:21.447398+0000) 2024-01-24T15:41:30.297 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:29 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:29.986+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:30.297 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:29 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:29.986+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:30.297 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:29 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:29.986+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:30.297 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:29 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:29.986+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:30.432 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:30 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:30.030+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:30.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:30 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:30.030+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:30.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:30 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:30.030+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:30.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:30 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:30.030+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:56.753817+0000 front 2024-01-24T15:40:56.753972+0000 (oldest deadline 2024-01-24T15:41:22.654000+0000) 2024-01-24T15:41:30.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:30 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:30.030+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.155111+0000 front 2024-01-24T15:41:03.155071+0000 (oldest deadline 2024-01-24T15:41:28.455072+0000) 2024-01-24T15:41:30.507 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:30 smithi160 bash[77362]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-7 2024-01-24T15:41:30.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:30 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:30.062+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:30.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:30 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:30.062+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:30.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:30 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:30.062+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:30.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:30 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:30.062+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:30.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:30 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:30.295+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:30.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:30 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:30.295+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:30.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:30 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:30.295+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:47.346087+0000 front 2024-01-24T15:40:47.346206+0000 (oldest deadline 2024-01-24T15:41:12.646189+0000) 2024-01-24T15:41:30.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:30 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:30.295+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:58.547328+0000 front 2024-01-24T15:40:58.547353+0000 (oldest deadline 2024-01-24T15:41:21.447398+0000) 2024-01-24T15:41:31.336 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:30 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:30.993+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:31.337 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:30 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:30.993+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:31.337 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:30 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:30.993+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:31.337 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:30 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:30.993+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:31.382 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:31 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:31.038+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:31.382 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:31 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:31.038+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:31.382 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:31 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:31.038+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:31.382 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:31 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:31.038+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:31.382 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:31 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:31.038+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:05.572776+0000 front 2024-01-24T15:41:05.572749+0000 (oldest deadline 2024-01-24T15:41:30.272860+0000) 2024-01-24T15:41:31.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:31 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:31.031+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:31.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:31 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:31.031+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:31.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:31 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:31.031+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:31.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:31 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:31.031+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:56.753817+0000 front 2024-01-24T15:40:56.753972+0000 (oldest deadline 2024-01-24T15:41:22.654000+0000) 2024-01-24T15:41:31.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:31 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:31.031+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.155111+0000 front 2024-01-24T15:41:03.155071+0000 (oldest deadline 2024-01-24T15:41:28.455072+0000) 2024-01-24T15:41:31.544 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.7.service' 2024-01-24T15:41:31.643 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:31 smithi160 systemd[1]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.7.service: Succeeded. 2024-01-24T15:41:31.644 INFO:journalctl@ceph.osd.7.smithi160.stdout:Jan 24 15:41:31 smithi160 systemd[1]: Stopped Ceph osd.7 for bede0bb6-bacd-11ee-95b1-87774f69a715. 2024-01-24T15:41:31.670 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:41:31.670 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-01-24T15:41:31.670 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-01-24T15:41:31.670 DEBUG:teuthology.orchestra.run.smithi204:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.8 2024-01-24T15:41:31.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:31 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:31.334+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:31.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:31 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:31.334+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:31.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:31 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:31.334+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:47.346087+0000 front 2024-01-24T15:40:47.346206+0000 (oldest deadline 2024-01-24T15:41:12.646189+0000) 2024-01-24T15:41:31.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:31 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:31.334+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:58.547328+0000 front 2024-01-24T15:40:58.547353+0000 (oldest deadline 2024-01-24T15:41:21.447398+0000) 2024-01-24T15:41:32.043 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:31 smithi204 systemd[1]: Stopping Ceph osd.8 for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:41:32.301 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:32 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:32.041+0000 7f4125c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:41:32.302 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:32 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:32.041+0000 7f4125c00700 -1 osd.8 82 *** Got signal Terminated *** 2024-01-24T15:41:32.302 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:32 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:32.041+0000 7f4125c00700 -1 osd.8 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-24T15:41:32.302 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:32 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:32.039+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:32.302 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:32 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:32.039+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:32.302 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:32 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:32.039+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:32.302 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:32 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:32.039+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:32.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:32 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:32.028+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:32.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:32 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:32.028+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:32.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:32 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:32.028+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:32.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:32 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:32.028+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:56.753817+0000 front 2024-01-24T15:40:56.753972+0000 (oldest deadline 2024-01-24T15:41:22.654000+0000) 2024-01-24T15:41:32.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:32 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:32.028+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.155111+0000 front 2024-01-24T15:41:03.155071+0000 (oldest deadline 2024-01-24T15:41:28.455072+0000) 2024-01-24T15:41:32.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:32 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:32.086+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:32.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:32 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:32.086+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:32.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:32 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:32.086+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:32.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:32 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:32.086+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:32.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:32 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:32.086+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:05.572776+0000 front 2024-01-24T15:41:05.572749+0000 (oldest deadline 2024-01-24T15:41:30.272860+0000) 2024-01-24T15:41:32.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:32 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:32.299+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:32.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:32 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:32.299+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:32.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:32 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:32.299+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:47.346087+0000 front 2024-01-24T15:40:47.346206+0000 (oldest deadline 2024-01-24T15:41:12.646189+0000) 2024-01-24T15:41:32.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:32 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:32.299+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:58.547328+0000 front 2024-01-24T15:40:58.547353+0000 (oldest deadline 2024-01-24T15:41:21.447398+0000) 2024-01-24T15:41:32.725 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:32 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:32.299+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.748944+0000 front 2024-01-24T15:41:03.748864+0000 (oldest deadline 2024-01-24T15:41:31.949445+0000) 2024-01-24T15:41:33.432 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:32 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:32.997+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:33.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:32 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:32.997+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:33.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:32 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:32.997+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:33.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:32 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:32.997+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:56.753817+0000 front 2024-01-24T15:40:56.753972+0000 (oldest deadline 2024-01-24T15:41:22.654000+0000) 2024-01-24T15:41:33.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:32 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:32.997+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.155111+0000 front 2024-01-24T15:41:03.155071+0000 (oldest deadline 2024-01-24T15:41:28.455072+0000) 2024-01-24T15:41:33.474 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:33 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:33.270+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:33.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:33 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:33.271+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:33.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:33 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:33.271+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:47.346087+0000 front 2024-01-24T15:40:47.346206+0000 (oldest deadline 2024-01-24T15:41:12.646189+0000) 2024-01-24T15:41:33.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:33 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:33.271+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:58.547328+0000 front 2024-01-24T15:40:58.547353+0000 (oldest deadline 2024-01-24T15:41:21.447398+0000) 2024-01-24T15:41:33.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:33 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:33.271+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.748944+0000 front 2024-01-24T15:41:03.748864+0000 (oldest deadline 2024-01-24T15:41:31.949445+0000) 2024-01-24T15:41:33.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:33 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:33.039+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:33.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:33 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:33.039+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:33.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:33 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:33.039+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:33.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:33 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:33.039+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:33.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:33 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:33.115+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:33.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:33 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:33.115+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:33.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:33 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:33.115+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:33.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:33 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:33.115+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:33.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:33 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:33.115+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:05.572776+0000 front 2024-01-24T15:41:05.572749+0000 (oldest deadline 2024-01-24T15:41:30.272860+0000) 2024-01-24T15:41:34.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:33 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:33.959+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:34.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:33 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:33.959+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:34.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:33 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:33.959+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:34.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:33 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:33.959+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:56.753817+0000 front 2024-01-24T15:40:56.753972+0000 (oldest deadline 2024-01-24T15:41:22.654000+0000) 2024-01-24T15:41:34.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:33 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:33.959+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.155111+0000 front 2024-01-24T15:41:03.155071+0000 (oldest deadline 2024-01-24T15:41:28.455072+0000) 2024-01-24T15:41:34.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:34 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:34.284+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:34.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:34 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:34.284+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:34.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:34 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:34.284+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:47.346087+0000 front 2024-01-24T15:40:47.346206+0000 (oldest deadline 2024-01-24T15:41:12.646189+0000) 2024-01-24T15:41:34.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:34 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:34.284+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:58.547328+0000 front 2024-01-24T15:40:58.547353+0000 (oldest deadline 2024-01-24T15:41:21.447398+0000) 2024-01-24T15:41:34.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:34 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:34.284+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.748944+0000 front 2024-01-24T15:41:03.748864+0000 (oldest deadline 2024-01-24T15:41:31.949445+0000) 2024-01-24T15:41:34.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:34 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:34.065+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:34.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:34 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:34.065+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:34.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:34 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:34.065+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:34.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:34 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:34.065+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:34.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:34 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:34.159+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:34.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:34 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:34.159+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:34.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:34 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:34.159+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:34.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:34 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:34.159+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:34.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:34 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:34.159+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:05.572776+0000 front 2024-01-24T15:41:05.572749+0000 (oldest deadline 2024-01-24T15:41:30.272860+0000) 2024-01-24T15:41:35.432 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:34 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:34.960+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:35.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:34 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:34.960+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:35.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:34 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:34.960+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:35.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:34 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:34.960+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:56.753817+0000 front 2024-01-24T15:40:56.753972+0000 (oldest deadline 2024-01-24T15:41:22.654000+0000) 2024-01-24T15:41:35.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:34 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:34.960+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.155111+0000 front 2024-01-24T15:41:03.155071+0000 (oldest deadline 2024-01-24T15:41:28.455072+0000) 2024-01-24T15:41:35.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:35 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:35.306+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:35.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:35 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:35.306+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:35.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:35 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:35.306+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:47.346087+0000 front 2024-01-24T15:40:47.346206+0000 (oldest deadline 2024-01-24T15:41:12.646189+0000) 2024-01-24T15:41:35.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:35 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:35.306+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:58.547328+0000 front 2024-01-24T15:40:58.547353+0000 (oldest deadline 2024-01-24T15:41:21.447398+0000) 2024-01-24T15:41:35.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:35 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:35.306+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.748944+0000 front 2024-01-24T15:41:03.748864+0000 (oldest deadline 2024-01-24T15:41:31.949445+0000) 2024-01-24T15:41:35.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:35 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:35.088+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:35.476 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:35 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:35.088+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:35.476 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:35 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:35.088+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:35.476 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:35 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:35.088+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:35.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:35 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:35.169+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:35.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:35 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:35.169+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:35.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:35 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:35.169+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:35.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:35 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:35.169+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:35.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:35 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:35.169+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:05.572776+0000 front 2024-01-24T15:41:05.572749+0000 (oldest deadline 2024-01-24T15:41:30.272860+0000) 2024-01-24T15:41:35.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:35 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:35.169+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.774109+0000 front 2024-01-24T15:41:13.773998+0000 (oldest deadline 2024-01-24T15:41:34.873936+0000) 2024-01-24T15:41:36.432 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:35 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:35.966+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:36.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:35 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:35.966+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:36.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:35 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:35.966+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:36.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:35 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:35.966+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:56.753817+0000 front 2024-01-24T15:40:56.753972+0000 (oldest deadline 2024-01-24T15:41:22.654000+0000) 2024-01-24T15:41:36.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:35 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:35.966+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.155111+0000 front 2024-01-24T15:41:03.155071+0000 (oldest deadline 2024-01-24T15:41:28.455072+0000) 2024-01-24T15:41:36.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:36 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:36.342+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.242287+0000 front 2024-01-24T15:40:35.242538+0000 (oldest deadline 2024-01-24T15:40:57.542297+0000) 2024-01-24T15:41:36.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:36 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:36.342+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.544733+0000 front 2024-01-24T15:40:41.544634+0000 (oldest deadline 2024-01-24T15:41:05.044750+0000) 2024-01-24T15:41:36.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:36 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:36.342+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:47.346087+0000 front 2024-01-24T15:40:47.346206+0000 (oldest deadline 2024-01-24T15:41:12.646189+0000) 2024-01-24T15:41:36.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:36 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:36.342+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:58.547328+0000 front 2024-01-24T15:40:58.547353+0000 (oldest deadline 2024-01-24T15:41:21.447398+0000) 2024-01-24T15:41:36.475 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:36 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8[61119]: 2024-01-24T15:41:36.342+0000 7f4120a00700 -1 osd.8 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.748944+0000 front 2024-01-24T15:41:03.748864+0000 (oldest deadline 2024-01-24T15:41:31.949445+0000) 2024-01-24T15:41:36.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:36 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:36.104+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:36.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:36 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:36.104+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:36.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:36 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:36.104+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:36.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:36 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:36.104+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:36.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:36 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:36.212+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:36.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:36 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:36.212+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:36.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:36 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:36.212+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:36.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:36 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:36.212+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:36.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:36 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:36.212+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:05.572776+0000 front 2024-01-24T15:41:05.572749+0000 (oldest deadline 2024-01-24T15:41:30.272860+0000) 2024-01-24T15:41:36.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:36 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:36.212+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.774109+0000 front 2024-01-24T15:41:13.773998+0000 (oldest deadline 2024-01-24T15:41:34.873936+0000) 2024-01-24T15:41:37.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:36 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:36.967+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:37.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:36 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:36.967+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:37.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:36 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:36.967+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:37.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:36 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:36.967+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:56.753817+0000 front 2024-01-24T15:40:56.753972+0000 (oldest deadline 2024-01-24T15:41:22.654000+0000) 2024-01-24T15:41:37.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:36 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:36.967+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.155111+0000 front 2024-01-24T15:41:03.155071+0000 (oldest deadline 2024-01-24T15:41:28.455072+0000) 2024-01-24T15:41:37.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:37 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:37.103+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:37.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:37 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:37.103+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:37.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:37 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:37.103+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:37.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:37 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:37.104+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:37.506 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:37 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:37.250+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:37.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:37 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:37.250+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:37.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:37 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:37.250+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:37.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:37 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:37.250+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:37.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:37 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:37.250+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:05.572776+0000 front 2024-01-24T15:41:05.572749+0000 (oldest deadline 2024-01-24T15:41:30.272860+0000) 2024-01-24T15:41:37.507 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:37 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:37.250+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.774109+0000 front 2024-01-24T15:41:13.773998+0000 (oldest deadline 2024-01-24T15:41:34.873936+0000) 2024-01-24T15:41:37.975 INFO:journalctl@ceph.osd.8.smithi204.stdout:Jan 24 15:41:37 smithi204 bash[78408]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-8 2024-01-24T15:41:38.182 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:37 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:37.929+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:38.183 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:37 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:37.929+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:38.183 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:37 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:37.929+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:38.183 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:37 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:37.929+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:56.753817+0000 front 2024-01-24T15:40:56.753972+0000 (oldest deadline 2024-01-24T15:41:22.654000+0000) 2024-01-24T15:41:38.183 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:37 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:37.929+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.155111+0000 front 2024-01-24T15:41:03.155071+0000 (oldest deadline 2024-01-24T15:41:28.455072+0000) 2024-01-24T15:41:38.467 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:38 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:38.077+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:38.467 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:38 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:38.077+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:38.467 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:38 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:38.077+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:38.467 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:38 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:38.077+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:38.467 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:38 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:38.077+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.720812+0000 front 2024-01-24T15:41:13.720845+0000 (oldest deadline 2024-01-24T15:41:37.220841+0000) 2024-01-24T15:41:38.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:38 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:38.296+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:38.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:38 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:38.296+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:38.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:38 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:38.296+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:38.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:38 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:38.296+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:38.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:38 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:38.296+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:05.572776+0000 front 2024-01-24T15:41:05.572749+0000 (oldest deadline 2024-01-24T15:41:30.272860+0000) 2024-01-24T15:41:38.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:38 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:38.296+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.774109+0000 front 2024-01-24T15:41:13.773998+0000 (oldest deadline 2024-01-24T15:41:34.873936+0000) 2024-01-24T15:41:39.184 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:38 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:38.884+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:39.184 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:38 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:38.884+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:39.184 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:38 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:38.884+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:39.184 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:38 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:38.884+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:56.753817+0000 front 2024-01-24T15:40:56.753972+0000 (oldest deadline 2024-01-24T15:41:22.654000+0000) 2024-01-24T15:41:39.184 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:38 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:38.884+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.155111+0000 front 2024-01-24T15:41:03.155071+0000 (oldest deadline 2024-01-24T15:41:28.455072+0000) 2024-01-24T15:41:39.225 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:39 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:39.066+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:39.225 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:39 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:39.066+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:39.225 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:39 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:39.066+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:39.225 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:39 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:39.066+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:39.225 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:39 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:39.066+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.720812+0000 front 2024-01-24T15:41:13.720845+0000 (oldest deadline 2024-01-24T15:41:37.220841+0000) 2024-01-24T15:41:39.357 DEBUG:teuthology.orchestra.run.smithi204:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.8.service' 2024-01-24T15:41:39.441 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:41:39.442 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-01-24T15:41:39.442 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-01-24T15:41:39.442 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.9 2024-01-24T15:41:39.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:39 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:39.317+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:39.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:39 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:39.317+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:39.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:39 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:39.317+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:39.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:39 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:39.317+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:39.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:39 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:39.317+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:05.572776+0000 front 2024-01-24T15:41:05.572749+0000 (oldest deadline 2024-01-24T15:41:30.272860+0000) 2024-01-24T15:41:39.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:39 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:39.317+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.774109+0000 front 2024-01-24T15:41:13.773998+0000 (oldest deadline 2024-01-24T15:41:34.873936+0000) 2024-01-24T15:41:39.834 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:39 smithi005 systemd[1]: Stopping Ceph osd.9 for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:41:40.183 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:39 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:39.831+0000 7fb56e800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:41:40.183 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:39 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:39.831+0000 7fb56e800700 -1 osd.9 82 *** Got signal Terminated *** 2024-01-24T15:41:40.183 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:39 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:39.831+0000 7fb56e800700 -1 osd.9 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-24T15:41:40.183 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:39 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:39.902+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:40.183 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:39 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:39.902+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:40.183 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:39 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:39.902+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:40.184 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:39 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:39.902+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:56.753817+0000 front 2024-01-24T15:40:56.753972+0000 (oldest deadline 2024-01-24T15:41:22.654000+0000) 2024-01-24T15:41:40.184 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:39 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:39.902+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.155111+0000 front 2024-01-24T15:41:03.155071+0000 (oldest deadline 2024-01-24T15:41:28.455072+0000) 2024-01-24T15:41:40.184 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:39 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:39.902+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.657124+0000 front 2024-01-24T15:41:13.657113+0000 (oldest deadline 2024-01-24T15:41:38.957041+0000) 2024-01-24T15:41:40.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:40 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:40.107+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:40.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:40 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:40.107+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:40.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:40 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:40.107+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:40.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:40 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:40.107+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:40.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:40 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:40.107+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.720812+0000 front 2024-01-24T15:41:13.720845+0000 (oldest deadline 2024-01-24T15:41:37.220841+0000) 2024-01-24T15:41:40.756 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:40 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:40.358+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:40.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:40 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:40.358+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:40.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:40 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:40.358+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:40.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:40 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:40.358+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:40.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:40 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:40.358+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:05.572776+0000 front 2024-01-24T15:41:05.572749+0000 (oldest deadline 2024-01-24T15:41:30.272860+0000) 2024-01-24T15:41:40.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:40 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:40.358+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.774109+0000 front 2024-01-24T15:41:13.773998+0000 (oldest deadline 2024-01-24T15:41:34.873936+0000) 2024-01-24T15:41:41.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:40 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:40.944+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:41.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:40 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:40.944+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:41.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:40 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:40.944+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:41.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:40 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:40.944+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:56.753817+0000 front 2024-01-24T15:40:56.753972+0000 (oldest deadline 2024-01-24T15:41:22.654000+0000) 2024-01-24T15:41:41.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:40 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:40.944+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.155111+0000 front 2024-01-24T15:41:03.155071+0000 (oldest deadline 2024-01-24T15:41:28.455072+0000) 2024-01-24T15:41:41.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:40 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:40.944+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.657124+0000 front 2024-01-24T15:41:13.657113+0000 (oldest deadline 2024-01-24T15:41:38.957041+0000) 2024-01-24T15:41:41.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:41 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:41.148+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:41.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:41 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:41.148+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:41.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:41 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:41.148+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:41.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:41 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:41.148+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:41.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:41 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:41.148+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.720812+0000 front 2024-01-24T15:41:13.720845+0000 (oldest deadline 2024-01-24T15:41:37.220841+0000) 2024-01-24T15:41:41.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:41 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:41.357+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:41.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:41 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:41.357+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:41.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:41 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:41.357+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:41.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:41 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:41.357+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:41.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:41 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:41.357+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:05.572776+0000 front 2024-01-24T15:41:05.572749+0000 (oldest deadline 2024-01-24T15:41:30.272860+0000) 2024-01-24T15:41:41.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:41 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:41.357+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.774109+0000 front 2024-01-24T15:41:13.773998+0000 (oldest deadline 2024-01-24T15:41:34.873936+0000) 2024-01-24T15:41:42.183 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:41 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:41.928+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:42.183 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:41 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:41.928+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:42.183 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:41 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:41.928+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:42.183 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:41 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:41.928+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:56.753817+0000 front 2024-01-24T15:40:56.753972+0000 (oldest deadline 2024-01-24T15:41:22.654000+0000) 2024-01-24T15:41:42.183 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:41 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:41.928+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.155111+0000 front 2024-01-24T15:41:03.155071+0000 (oldest deadline 2024-01-24T15:41:28.455072+0000) 2024-01-24T15:41:42.183 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:41 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:41.928+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.657124+0000 front 2024-01-24T15:41:13.657113+0000 (oldest deadline 2024-01-24T15:41:38.957041+0000) 2024-01-24T15:41:42.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:42 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:42.164+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:42.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:42 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:42.164+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:42.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:42 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:42.164+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:42.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:42 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:42.164+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:42.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:42 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:42.164+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.720812+0000 front 2024-01-24T15:41:13.720845+0000 (oldest deadline 2024-01-24T15:41:37.220841+0000) 2024-01-24T15:41:42.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:42 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:42.375+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:42.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:42 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:42.375+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:42.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:42 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:42.375+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:42.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:42 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:42.375+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:42.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:42 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:42.375+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:05.572776+0000 front 2024-01-24T15:41:05.572749+0000 (oldest deadline 2024-01-24T15:41:30.272860+0000) 2024-01-24T15:41:42.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:42 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:42.375+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.774109+0000 front 2024-01-24T15:41:13.773998+0000 (oldest deadline 2024-01-24T15:41:34.873936+0000) 2024-01-24T15:41:43.432 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:42 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:42.970+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:43.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:42 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:42.970+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:43.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:42 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:42.970+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:43.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:42 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:42.970+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:56.753817+0000 front 2024-01-24T15:40:56.753972+0000 (oldest deadline 2024-01-24T15:41:22.654000+0000) 2024-01-24T15:41:43.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:42 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:42.970+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.155111+0000 front 2024-01-24T15:41:03.155071+0000 (oldest deadline 2024-01-24T15:41:28.455072+0000) 2024-01-24T15:41:43.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:42 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:42.970+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.657124+0000 front 2024-01-24T15:41:13.657113+0000 (oldest deadline 2024-01-24T15:41:38.957041+0000) 2024-01-24T15:41:43.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:43 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:43.155+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:43.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:43 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:43.155+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:43.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:43 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:43.155+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:43.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:43 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:43.155+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:43.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:43 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:43.155+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.720812+0000 front 2024-01-24T15:41:13.720845+0000 (oldest deadline 2024-01-24T15:41:37.220841+0000) 2024-01-24T15:41:43.756 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:43 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:43.397+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:43.756 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:43 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:43.397+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:43.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:43 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:43.397+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:43.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:43 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:43.397+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:43.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:43 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:43.397+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:05.572776+0000 front 2024-01-24T15:41:05.572749+0000 (oldest deadline 2024-01-24T15:41:30.272860+0000) 2024-01-24T15:41:43.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:43 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:43.397+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.774109+0000 front 2024-01-24T15:41:13.773998+0000 (oldest deadline 2024-01-24T15:41:34.873936+0000) 2024-01-24T15:41:44.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:44 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:44.009+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.349582+0000 front 2024-01-24T15:40:33.349882+0000 (oldest deadline 2024-01-24T15:40:59.249889+0000) 2024-01-24T15:41:44.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:44 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:44.009+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:39.250793+0000 front 2024-01-24T15:40:39.250908+0000 (oldest deadline 2024-01-24T15:41:03.950701+0000) 2024-01-24T15:41:44.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:44 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:44.009+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:49.252278+0000 front 2024-01-24T15:40:49.252289+0000 (oldest deadline 2024-01-24T15:41:11.552334+0000) 2024-01-24T15:41:44.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:44 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:44.009+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:56.753817+0000 front 2024-01-24T15:40:56.753972+0000 (oldest deadline 2024-01-24T15:41:22.654000+0000) 2024-01-24T15:41:44.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:44 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:44.009+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.155111+0000 front 2024-01-24T15:41:03.155071+0000 (oldest deadline 2024-01-24T15:41:28.455072+0000) 2024-01-24T15:41:44.433 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:44 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9[77785]: 2024-01-24T15:41:44.010+0000 7fb565a00700 -1 osd.9 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.657124+0000 front 2024-01-24T15:41:13.657113+0000 (oldest deadline 2024-01-24T15:41:38.957041+0000) 2024-01-24T15:41:44.474 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:44 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:44.129+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:44.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:44 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:44.129+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:44.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:44 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:44.129+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:44.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:44 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:44.129+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:44.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:44 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:44.129+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.720812+0000 front 2024-01-24T15:41:13.720845+0000 (oldest deadline 2024-01-24T15:41:37.220841+0000) 2024-01-24T15:41:44.756 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:44 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:44.378+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:44.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:44 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:44.378+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:44.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:44 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:44.378+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:44.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:44 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:44.378+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:44.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:44 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:44.378+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:05.572776+0000 front 2024-01-24T15:41:05.572749+0000 (oldest deadline 2024-01-24T15:41:30.272860+0000) 2024-01-24T15:41:44.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:44 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:44.378+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.774109+0000 front 2024-01-24T15:41:13.773998+0000 (oldest deadline 2024-01-24T15:41:34.873936+0000) 2024-01-24T15:41:44.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:44 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:44.378+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-01-24T15:41:18.375227+0000 front 2024-01-24T15:41:18.375114+0000 (oldest deadline 2024-01-24T15:41:44.275030+0000) 2024-01-24T15:41:45.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:45 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:45.145+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:45.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:45 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:45.145+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:45.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:45 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:45.145+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:45.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:45 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:45.145+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:45.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:45 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:45.145+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.720812+0000 front 2024-01-24T15:41:13.720845+0000 (oldest deadline 2024-01-24T15:41:37.220841+0000) 2024-01-24T15:41:45.682 INFO:journalctl@ceph.osd.9.smithi005.stdout:Jan 24 15:41:45 smithi005 bash[89089]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-9 2024-01-24T15:41:45.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:45 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:45.423+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:45.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:45 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:45.423+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:45.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:45 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:45.423+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:45.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:45 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:45.423+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:45.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:45 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:45.423+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:05.572776+0000 front 2024-01-24T15:41:05.572749+0000 (oldest deadline 2024-01-24T15:41:30.272860+0000) 2024-01-24T15:41:45.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:45 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:45.423+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.774109+0000 front 2024-01-24T15:41:13.773998+0000 (oldest deadline 2024-01-24T15:41:34.873936+0000) 2024-01-24T15:41:45.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:45 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:45.423+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-01-24T15:41:18.375227+0000 front 2024-01-24T15:41:18.375114+0000 (oldest deadline 2024-01-24T15:41:44.275030+0000) 2024-01-24T15:41:46.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:46 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:46.164+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:46.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:46 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:46.164+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:46.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:46 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:46.164+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:46.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:46 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:46.164+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:46.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:46 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:46.164+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.720812+0000 front 2024-01-24T15:41:13.720845+0000 (oldest deadline 2024-01-24T15:41:37.220841+0000) 2024-01-24T15:41:46.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:46 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:46.164+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-01-24T15:41:21.623476+0000 front 2024-01-24T15:41:21.623515+0000 (oldest deadline 2024-01-24T15:41:45.723590+0000) 2024-01-24T15:41:46.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:46 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:46.441+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:46.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:46 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:46.441+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:46.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:46 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:46.441+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:46.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:46 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:46.441+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:46.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:46 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:46.441+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:05.572776+0000 front 2024-01-24T15:41:05.572749+0000 (oldest deadline 2024-01-24T15:41:30.272860+0000) 2024-01-24T15:41:46.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:46 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:46.441+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.774109+0000 front 2024-01-24T15:41:13.773998+0000 (oldest deadline 2024-01-24T15:41:34.873936+0000) 2024-01-24T15:41:46.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:46 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:46.441+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-01-24T15:41:18.375227+0000 front 2024-01-24T15:41:18.375114+0000 (oldest deadline 2024-01-24T15:41:44.275030+0000) 2024-01-24T15:41:46.916 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.9.service' 2024-01-24T15:41:47.001 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:41:47.001 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-01-24T15:41:47.001 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-01-24T15:41:47.001 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.10 2024-01-24T15:41:47.361 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:47 smithi160 systemd[1]: Stopping Ceph osd.10 for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:41:47.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:47 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:47.170+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:47.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:47 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:47.170+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:47.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:47 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:47.170+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:47.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:47 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:47.170+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:47.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:47 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:47.170+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.720812+0000 front 2024-01-24T15:41:13.720845+0000 (oldest deadline 2024-01-24T15:41:37.220841+0000) 2024-01-24T15:41:47.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:47 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:47.170+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-01-24T15:41:21.623476+0000 front 2024-01-24T15:41:21.623515+0000 (oldest deadline 2024-01-24T15:41:45.723590+0000) 2024-01-24T15:41:47.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:47 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:47.359+0000 7f8703e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:41:47.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:47 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:47.359+0000 7f8703e00700 -1 osd.10 82 *** Got signal Terminated *** 2024-01-24T15:41:47.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:47 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:47.359+0000 7f8703e00700 -1 osd.10 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-24T15:41:47.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:47 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:47.416+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:47.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:47 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:47.416+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:47.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:47 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:47.416+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:47.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:47 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:47.416+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:47.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:47 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:47.416+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:05.572776+0000 front 2024-01-24T15:41:05.572749+0000 (oldest deadline 2024-01-24T15:41:30.272860+0000) 2024-01-24T15:41:47.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:47 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:47.416+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.774109+0000 front 2024-01-24T15:41:13.773998+0000 (oldest deadline 2024-01-24T15:41:34.873936+0000) 2024-01-24T15:41:47.758 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:47 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:47.416+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-01-24T15:41:18.375227+0000 front 2024-01-24T15:41:18.375114+0000 (oldest deadline 2024-01-24T15:41:44.275030+0000) 2024-01-24T15:41:48.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:48 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:48.144+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:48.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:48 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:48.144+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:48.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:48 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:48.144+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:48.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:48 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:48.144+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:48.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:48 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:48.144+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.720812+0000 front 2024-01-24T15:41:13.720845+0000 (oldest deadline 2024-01-24T15:41:37.220841+0000) 2024-01-24T15:41:48.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:48 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:48.144+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-01-24T15:41:21.623476+0000 front 2024-01-24T15:41:21.623515+0000 (oldest deadline 2024-01-24T15:41:45.723590+0000) 2024-01-24T15:41:48.756 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:48 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:48.427+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:48.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:48 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:48.427+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:48.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:48 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:48.427+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:48.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:48 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:48.427+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:48.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:48 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:48.427+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:05.572776+0000 front 2024-01-24T15:41:05.572749+0000 (oldest deadline 2024-01-24T15:41:30.272860+0000) 2024-01-24T15:41:48.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:48 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:48.427+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.774109+0000 front 2024-01-24T15:41:13.773998+0000 (oldest deadline 2024-01-24T15:41:34.873936+0000) 2024-01-24T15:41:48.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:48 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:48.427+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-01-24T15:41:18.375227+0000 front 2024-01-24T15:41:18.375114+0000 (oldest deadline 2024-01-24T15:41:44.275030+0000) 2024-01-24T15:41:49.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:49 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:49.129+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:49.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:49 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:49.129+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:49.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:49 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:49.129+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:49.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:49 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:49.129+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:49.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:49 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:49.129+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.720812+0000 front 2024-01-24T15:41:13.720845+0000 (oldest deadline 2024-01-24T15:41:37.220841+0000) 2024-01-24T15:41:49.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:49 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:49.129+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-01-24T15:41:21.623476+0000 front 2024-01-24T15:41:21.623515+0000 (oldest deadline 2024-01-24T15:41:45.723590+0000) 2024-01-24T15:41:49.756 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:49 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:49.400+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:49.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:49 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:49.400+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:49.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:49 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:49.400+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:49.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:49 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:49.400+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:49.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:49 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:49.400+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:05.572776+0000 front 2024-01-24T15:41:05.572749+0000 (oldest deadline 2024-01-24T15:41:30.272860+0000) 2024-01-24T15:41:49.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:49 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:49.400+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.774109+0000 front 2024-01-24T15:41:13.773998+0000 (oldest deadline 2024-01-24T15:41:34.873936+0000) 2024-01-24T15:41:49.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:49 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:49.400+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-01-24T15:41:18.375227+0000 front 2024-01-24T15:41:18.375114+0000 (oldest deadline 2024-01-24T15:41:44.275030+0000) 2024-01-24T15:41:50.474 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:50 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:50.127+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:50.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:50 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:50.127+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:50.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:50 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:50.127+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:50.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:50 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:50.127+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:50.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:50 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:50.127+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.720812+0000 front 2024-01-24T15:41:13.720845+0000 (oldest deadline 2024-01-24T15:41:37.220841+0000) 2024-01-24T15:41:50.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:50 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:50.127+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-01-24T15:41:21.623476+0000 front 2024-01-24T15:41:21.623515+0000 (oldest deadline 2024-01-24T15:41:45.723590+0000) 2024-01-24T15:41:50.756 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:50 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:50.381+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:50.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:50 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:50.381+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:50.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:50 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:50.381+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:50.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:50 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:50.381+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:50.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:50 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:50.381+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:05.572776+0000 front 2024-01-24T15:41:05.572749+0000 (oldest deadline 2024-01-24T15:41:30.272860+0000) 2024-01-24T15:41:50.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:50 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:50.381+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.774109+0000 front 2024-01-24T15:41:13.773998+0000 (oldest deadline 2024-01-24T15:41:34.873936+0000) 2024-01-24T15:41:50.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:50 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:50.381+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-01-24T15:41:18.375227+0000 front 2024-01-24T15:41:18.375114+0000 (oldest deadline 2024-01-24T15:41:44.275030+0000) 2024-01-24T15:41:51.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:51 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:51.120+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:51.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:51 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:51.120+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:51.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:51 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:51.120+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:51.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:51 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:51.120+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:51.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:51 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:51.120+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.720812+0000 front 2024-01-24T15:41:13.720845+0000 (oldest deadline 2024-01-24T15:41:37.220841+0000) 2024-01-24T15:41:51.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:51 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:51.120+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-01-24T15:41:21.623476+0000 front 2024-01-24T15:41:21.623515+0000 (oldest deadline 2024-01-24T15:41:45.723590+0000) 2024-01-24T15:41:51.756 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:51 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:51.372+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:35.366985+0000 front 2024-01-24T15:40:35.366970+0000 (oldest deadline 2024-01-24T15:41:00.067045+0000) 2024-01-24T15:41:51.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:51 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:51.372+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:40.067509+0000 front 2024-01-24T15:40:40.067536+0000 (oldest deadline 2024-01-24T15:41:06.468370+0000) 2024-01-24T15:41:51.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:51 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:51.372+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:48.769795+0000 front 2024-01-24T15:40:48.769725+0000 (oldest deadline 2024-01-24T15:41:11.669564+0000) 2024-01-24T15:41:51.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:51 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:51.372+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-01-24T15:40:57.371964+0000 front 2024-01-24T15:40:57.371921+0000 (oldest deadline 2024-01-24T15:41:20.271706+0000) 2024-01-24T15:41:51.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:51 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:51.372+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:05.572776+0000 front 2024-01-24T15:41:05.572749+0000 (oldest deadline 2024-01-24T15:41:30.272860+0000) 2024-01-24T15:41:51.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:51 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:51.372+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.774109+0000 front 2024-01-24T15:41:13.773998+0000 (oldest deadline 2024-01-24T15:41:34.873936+0000) 2024-01-24T15:41:51.757 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:51 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10[68818]: 2024-01-24T15:41:51.372+0000 7f86fc400700 -1 osd.10 82 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-01-24T15:41:18.375227+0000 front 2024-01-24T15:41:18.375114+0000 (oldest deadline 2024-01-24T15:41:44.275030+0000) 2024-01-24T15:41:52.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:52 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:52.143+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:52.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:52 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:52.143+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:52.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:52 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:52.143+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:52.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:52 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:52.143+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:52.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:52 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:52.143+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.720812+0000 front 2024-01-24T15:41:13.720845+0000 (oldest deadline 2024-01-24T15:41:37.220841+0000) 2024-01-24T15:41:52.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:52 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:52.143+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-01-24T15:41:21.623476+0000 front 2024-01-24T15:41:21.623515+0000 (oldest deadline 2024-01-24T15:41:45.723590+0000) 2024-01-24T15:41:53.257 INFO:journalctl@ceph.osd.10.smithi160.stdout:Jan 24 15:41:52 smithi160 bash[77628]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-10 2024-01-24T15:41:53.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:53 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:53.170+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:53.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:53 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:53.170+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:53.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:53 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:53.170+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:53.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:53 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:53.170+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:53.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:53 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:53.170+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.720812+0000 front 2024-01-24T15:41:13.720845+0000 (oldest deadline 2024-01-24T15:41:37.220841+0000) 2024-01-24T15:41:53.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:53 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:53.170+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-01-24T15:41:21.623476+0000 front 2024-01-24T15:41:21.623515+0000 (oldest deadline 2024-01-24T15:41:45.723590+0000) 2024-01-24T15:41:53.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:53 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:53.170+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6820 osd.7 since back 2024-01-24T15:41:27.424854+0000 front 2024-01-24T15:41:27.424843+0000 (oldest deadline 2024-01-24T15:41:52.724688+0000) 2024-01-24T15:41:54.312 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.10.service' 2024-01-24T15:41:54.396 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:41:54.397 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-01-24T15:41:54.397 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-01-24T15:41:54.397 DEBUG:teuthology.orchestra.run.smithi204:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.11 2024-01-24T15:41:54.460 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:54 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:54.199+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:54.460 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:54 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:54.199+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:54.460 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:54 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:54.199+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:54.460 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:54 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:54.199+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:54.460 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:54 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:54.199+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.720812+0000 front 2024-01-24T15:41:13.720845+0000 (oldest deadline 2024-01-24T15:41:37.220841+0000) 2024-01-24T15:41:54.460 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:54 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:54.199+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-01-24T15:41:21.623476+0000 front 2024-01-24T15:41:21.623515+0000 (oldest deadline 2024-01-24T15:41:45.723590+0000) 2024-01-24T15:41:54.460 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:54 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:54.199+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6820 osd.7 since back 2024-01-24T15:41:27.424854+0000 front 2024-01-24T15:41:27.424843+0000 (oldest deadline 2024-01-24T15:41:52.724688+0000) 2024-01-24T15:41:54.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:54 smithi204 systemd[1]: Stopping Ceph osd.11 for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:41:55.217 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:54 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:54.780+0000 7fa756000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:41:55.217 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:54 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:54.780+0000 7fa756000700 -1 osd.11 82 *** Got signal Terminated *** 2024-01-24T15:41:55.217 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:54 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:54.780+0000 7fa756000700 -1 osd.11 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-24T15:41:55.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:55 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:55.215+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:55.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:55 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:55.215+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:55.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:55 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:55.215+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:55.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:55 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:55.215+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:55.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:55 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:55.215+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.720812+0000 front 2024-01-24T15:41:13.720845+0000 (oldest deadline 2024-01-24T15:41:37.220841+0000) 2024-01-24T15:41:55.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:55 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:55.215+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-01-24T15:41:21.623476+0000 front 2024-01-24T15:41:21.623515+0000 (oldest deadline 2024-01-24T15:41:45.723590+0000) 2024-01-24T15:41:55.475 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:55 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:55.215+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6820 osd.7 since back 2024-01-24T15:41:27.424854+0000 front 2024-01-24T15:41:27.424843+0000 (oldest deadline 2024-01-24T15:41:52.724688+0000) 2024-01-24T15:41:56.724 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:56 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:56.264+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:56.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:56 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:56.264+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:56.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:56 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:56.264+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:56.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:56 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:56.264+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:56.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:56 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:56.264+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.720812+0000 front 2024-01-24T15:41:13.720845+0000 (oldest deadline 2024-01-24T15:41:37.220841+0000) 2024-01-24T15:41:56.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:56 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:56.264+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-01-24T15:41:21.623476+0000 front 2024-01-24T15:41:21.623515+0000 (oldest deadline 2024-01-24T15:41:45.723590+0000) 2024-01-24T15:41:56.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:56 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:56.264+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6820 osd.7 since back 2024-01-24T15:41:27.424854+0000 front 2024-01-24T15:41:27.424843+0000 (oldest deadline 2024-01-24T15:41:52.724688+0000) 2024-01-24T15:41:57.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:57 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:57.305+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:57.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:57 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:57.305+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:57.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:57 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:57.305+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:57.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:57 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:57.305+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:57.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:57 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:57.305+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.720812+0000 front 2024-01-24T15:41:13.720845+0000 (oldest deadline 2024-01-24T15:41:37.220841+0000) 2024-01-24T15:41:57.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:57 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:57.305+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-01-24T15:41:21.623476+0000 front 2024-01-24T15:41:21.623515+0000 (oldest deadline 2024-01-24T15:41:45.723590+0000) 2024-01-24T15:41:57.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:57 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:57.305+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6820 osd.7 since back 2024-01-24T15:41:27.424854+0000 front 2024-01-24T15:41:27.424843+0000 (oldest deadline 2024-01-24T15:41:52.724688+0000) 2024-01-24T15:41:58.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:58 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:58.326+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:58.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:58 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:58.326+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:58.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:58 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:58.326+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:58.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:58 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:58.326+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:58.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:58 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:58.326+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.720812+0000 front 2024-01-24T15:41:13.720845+0000 (oldest deadline 2024-01-24T15:41:37.220841+0000) 2024-01-24T15:41:58.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:58 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:58.326+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-01-24T15:41:21.623476+0000 front 2024-01-24T15:41:21.623515+0000 (oldest deadline 2024-01-24T15:41:45.723590+0000) 2024-01-24T15:41:58.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:58 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:58.326+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6820 osd.7 since back 2024-01-24T15:41:27.424854+0000 front 2024-01-24T15:41:27.424843+0000 (oldest deadline 2024-01-24T15:41:52.724688+0000) 2024-01-24T15:41:58.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:58 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:58.326+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6820 osd.8 since back 2024-01-24T15:41:35.526159+0000 front 2024-01-24T15:41:35.526118+0000 (oldest deadline 2024-01-24T15:41:57.826185+0000) 2024-01-24T15:41:59.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:59 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:59.351+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-01-24T15:40:33.613040+0000 front 2024-01-24T15:40:33.613071+0000 (oldest deadline 2024-01-24T15:40:58.913237+0000) 2024-01-24T15:41:59.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:59 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:59.351+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6804 osd.1 since back 2024-01-24T15:40:41.715302+0000 front 2024-01-24T15:40:41.715534+0000 (oldest deadline 2024-01-24T15:41:05.815220+0000) 2024-01-24T15:41:59.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:59 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:59.351+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6804 osd.2 since back 2024-01-24T15:40:45.815842+0000 front 2024-01-24T15:40:45.815733+0000 (oldest deadline 2024-01-24T15:41:12.816296+0000) 2024-01-24T15:41:59.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:59 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:59.351+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6812 osd.4 since back 2024-01-24T15:41:03.819490+0000 front 2024-01-24T15:41:03.819290+0000 (oldest deadline 2024-01-24T15:41:27.919225+0000) 2024-01-24T15:41:59.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:59 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:59.351+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6812 osd.5 since back 2024-01-24T15:41:13.720812+0000 front 2024-01-24T15:41:13.720845+0000 (oldest deadline 2024-01-24T15:41:37.220841+0000) 2024-01-24T15:41:59.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:59 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:59.351+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-01-24T15:41:21.623476+0000 front 2024-01-24T15:41:21.623515+0000 (oldest deadline 2024-01-24T15:41:45.723590+0000) 2024-01-24T15:41:59.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:59 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:59.351+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.160:6820 osd.7 since back 2024-01-24T15:41:27.424854+0000 front 2024-01-24T15:41:27.424843+0000 (oldest deadline 2024-01-24T15:41:52.724688+0000) 2024-01-24T15:41:59.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:41:59 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11[69738]: 2024-01-24T15:41:59.351+0000 7fa750400700 -1 osd.11 82 heartbeat_check: no reply from 172.21.15.204:6820 osd.8 since back 2024-01-24T15:41:35.526159+0000 front 2024-01-24T15:41:35.526118+0000 (oldest deadline 2024-01-24T15:41:57.826185+0000) 2024-01-24T15:42:00.725 INFO:journalctl@ceph.osd.11.smithi204.stdout:Jan 24 15:42:00 smithi204 bash[78664]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-osd-11 2024-01-24T15:42:02.153 DEBUG:teuthology.orchestra.run.smithi204:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@osd.11.service' 2024-01-24T15:42:02.238 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:42:02.238 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-01-24T15:42:02.238 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-01-24T15:42:02.238 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.a 2024-01-24T15:42:02.614 INFO:journalctl@ceph.mds.a.smithi005.stdout:Jan 24 15:42:02 smithi005 systemd[1]: Stopping Ceph mds.a for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:42:02.932 INFO:journalctl@ceph.mds.a.smithi005.stdout:Jan 24 15:42:02 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-a[86117]: 2024-01-24T15:42:02.612+0000 7ff8bba00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:42:02.932 INFO:journalctl@ceph.mds.a.smithi005.stdout:Jan 24 15:42:02 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-a[86117]: 2024-01-24T15:42:02.612+0000 7ff8bba00700 -1 mds.a *** got signal Terminated *** 2024-01-24T15:42:04.682 INFO:journalctl@ceph.mds.a.smithi005.stdout:Jan 24 15:42:04 smithi005 bash[89353]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-a 2024-01-24T15:42:04.881 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.a.service' 2024-01-24T15:42:04.959 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:42:04.960 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-01-24T15:42:04.960 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-01-24T15:42:04.960 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.d 2024-01-24T15:42:05.182 INFO:journalctl@ceph.mds.d.smithi005.stdout:Jan 24 15:42:05 smithi005 systemd[1]: Stopping Ceph mds.d for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:42:05.683 INFO:journalctl@ceph.mds.d.smithi005.stdout:Jan 24 15:42:05 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-d[85114]: 2024-01-24T15:42:05.311+0000 7f294cc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:42:05.683 INFO:journalctl@ceph.mds.d.smithi005.stdout:Jan 24 15:42:05 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-d[85114]: 2024-01-24T15:42:05.311+0000 7f294cc00700 -1 mds.d *** got signal Terminated *** 2024-01-24T15:42:06.683 INFO:journalctl@ceph.mds.d.smithi005.stdout:Jan 24 15:42:06 smithi005 bash[89492]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-d 2024-01-24T15:42:06.862 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.d.service' 2024-01-24T15:42:06.939 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:42:06.940 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-01-24T15:42:06.940 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-01-24T15:42:06.940 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.g 2024-01-24T15:42:07.182 INFO:journalctl@ceph.mds.g.smithi005.stdout:Jan 24 15:42:07 smithi005 systemd[1]: Stopping Ceph mds.g for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:42:07.683 INFO:journalctl@ceph.mds.g.smithi005.stdout:Jan 24 15:42:07 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-g[85733]: 2024-01-24T15:42:07.285+0000 7f5b4e600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:42:07.683 INFO:journalctl@ceph.mds.g.smithi005.stdout:Jan 24 15:42:07 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-g[85733]: 2024-01-24T15:42:07.285+0000 7f5b4e600700 -1 mds.g *** got signal Terminated *** 2024-01-24T15:42:10.683 INFO:journalctl@ceph.mds.g.smithi005.stdout:Jan 24 15:42:10 smithi005 bash[89631]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-g 2024-01-24T15:42:10.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.g.service' 2024-01-24T15:42:10.920 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:42:10.920 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-01-24T15:42:10.921 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-01-24T15:42:10.921 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.j 2024-01-24T15:42:11.182 INFO:journalctl@ceph.mds.j.smithi005.stdout:Jan 24 15:42:11 smithi005 systemd[1]: Stopping Ceph mds.j for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:42:11.683 INFO:journalctl@ceph.mds.j.smithi005.stdout:Jan 24 15:42:11 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-j[84726]: 2024-01-24T15:42:11.259+0000 7f9998e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:42:11.683 INFO:journalctl@ceph.mds.j.smithi005.stdout:Jan 24 15:42:11 smithi005 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-j[84726]: 2024-01-24T15:42:11.259+0000 7f9998e00700 -1 mds.j *** got signal Terminated *** 2024-01-24T15:42:15.682 INFO:journalctl@ceph.mds.j.smithi005.stdout:Jan 24 15:42:15 smithi005 bash[89770]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-j 2024-01-24T15:42:15.841 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.j.service' 2024-01-24T15:42:15.917 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:42:15.918 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-01-24T15:42:15.918 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-01-24T15:42:15.918 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.b 2024-01-24T15:42:16.256 INFO:journalctl@ceph.mds.b.smithi160.stdout:Jan 24 15:42:16 smithi160 systemd[1]: Stopping Ceph mds.b for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:42:16.756 INFO:journalctl@ceph.mds.b.smithi160.stdout:Jan 24 15:42:16 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-b[75180]: 2024-01-24T15:42:16.279+0000 7fcb47400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:42:16.756 INFO:journalctl@ceph.mds.b.smithi160.stdout:Jan 24 15:42:16 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-b[75180]: 2024-01-24T15:42:16.279+0000 7fcb47400700 -1 mds.b *** got signal Terminated *** 2024-01-24T15:42:23.978 INFO:journalctl@ceph.mds.b.smithi160.stdout:Jan 24 15:42:23 smithi160 bash[77888]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-b 2024-01-24T15:42:24.002 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.b.service' 2024-01-24T15:42:24.083 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:42:24.083 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-01-24T15:42:24.084 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-01-24T15:42:24.084 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.e 2024-01-24T15:42:24.257 INFO:journalctl@ceph.mds.e.smithi160.stdout:Jan 24 15:42:24 smithi160 systemd[1]: Stopping Ceph mds.e for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:42:24.756 INFO:journalctl@ceph.mds.e.smithi160.stdout:Jan 24 15:42:24 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-e[74464]: 2024-01-24T15:42:24.436+0000 7f8b4f000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:42:24.757 INFO:journalctl@ceph.mds.e.smithi160.stdout:Jan 24 15:42:24 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-e[74464]: 2024-01-24T15:42:24.436+0000 7f8b4f000700 -1 mds.e *** got signal Terminated *** 2024-01-24T15:42:28.940 INFO:journalctl@ceph.mds.e.smithi160.stdout:Jan 24 15:42:28 smithi160 bash[78026]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-e 2024-01-24T15:42:28.964 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.e.service' 2024-01-24T15:42:29.043 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:42:29.043 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-01-24T15:42:29.043 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-01-24T15:42:29.043 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.h 2024-01-24T15:42:29.256 INFO:journalctl@ceph.mds.h.smithi160.stdout:Jan 24 15:42:29 smithi160 systemd[1]: Stopping Ceph mds.h for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:42:29.757 INFO:journalctl@ceph.mds.h.smithi160.stdout:Jan 24 15:42:29 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-h[74819]: 2024-01-24T15:42:29.386+0000 7f43c4600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:42:29.757 INFO:journalctl@ceph.mds.h.smithi160.stdout:Jan 24 15:42:29 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-h[74819]: 2024-01-24T15:42:29.386+0000 7f43c4600700 -1 mds.h *** got signal Terminated *** 2024-01-24T15:42:33.257 INFO:journalctl@ceph.mds.h.smithi160.stdout:Jan 24 15:42:32 smithi160 bash[78167]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-h 2024-01-24T15:42:33.289 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.h.service' 2024-01-24T15:42:33.367 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:42:33.367 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-01-24T15:42:33.367 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-01-24T15:42:33.368 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.k 2024-01-24T15:42:33.720 INFO:journalctl@ceph.mds.k.smithi160.stdout:Jan 24 15:42:33 smithi160 systemd[1]: Stopping Ceph mds.k for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:42:34.006 INFO:journalctl@ceph.mds.k.smithi160.stdout:Jan 24 15:42:33 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-k[74048]: 2024-01-24T15:42:33.719+0000 7f7544e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:42:34.007 INFO:journalctl@ceph.mds.k.smithi160.stdout:Jan 24 15:42:33 smithi160 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-k[74048]: 2024-01-24T15:42:33.719+0000 7f7544e00700 -1 mds.k *** got signal Terminated *** 2024-01-24T15:42:38.007 INFO:journalctl@ceph.mds.k.smithi160.stdout:Jan 24 15:42:37 smithi160 bash[78305]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-k 2024-01-24T15:42:38.159 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.k.service' 2024-01-24T15:42:38.238 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:42:38.239 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-01-24T15:42:38.239 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-01-24T15:42:38.239 DEBUG:teuthology.orchestra.run.smithi204:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.c 2024-01-24T15:42:38.652 INFO:journalctl@ceph.mds.c.smithi204.stdout:Jan 24 15:42:38 smithi204 systemd[1]: Stopping Ceph mds.c for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:42:38.975 INFO:journalctl@ceph.mds.c.smithi204.stdout:Jan 24 15:42:38 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-c[75848]: 2024-01-24T15:42:38.648+0000 7fcbb6800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:42:38.975 INFO:journalctl@ceph.mds.c.smithi204.stdout:Jan 24 15:42:38 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-c[75848]: 2024-01-24T15:42:38.648+0000 7fcbb6800700 -1 mds.c *** got signal Terminated *** 2024-01-24T15:42:42.974 INFO:journalctl@ceph.mds.c.smithi204.stdout:Jan 24 15:42:42 smithi204 bash[78932]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-c 2024-01-24T15:42:43.005 DEBUG:teuthology.orchestra.run.smithi204:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.c.service' 2024-01-24T15:42:43.087 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:42:43.087 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-01-24T15:42:43.087 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-01-24T15:42:43.087 DEBUG:teuthology.orchestra.run.smithi204:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.f 2024-01-24T15:42:43.459 INFO:journalctl@ceph.mds.f.smithi204.stdout:Jan 24 15:42:43 smithi204 systemd[1]: Stopping Ceph mds.f for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:42:43.725 INFO:journalctl@ceph.mds.f.smithi204.stdout:Jan 24 15:42:43 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-f[75505]: 2024-01-24T15:42:43.455+0000 7fb1cd800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:42:43.725 INFO:journalctl@ceph.mds.f.smithi204.stdout:Jan 24 15:42:43 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-f[75505]: 2024-01-24T15:42:43.455+0000 7fb1cd800700 -1 mds.f *** got signal Terminated *** 2024-01-24T15:42:48.225 INFO:journalctl@ceph.mds.f.smithi204.stdout:Jan 24 15:42:47 smithi204 bash[79071]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-f 2024-01-24T15:42:48.330 DEBUG:teuthology.orchestra.run.smithi204:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.f.service' 2024-01-24T15:42:48.407 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:42:48.407 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-01-24T15:42:48.407 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-01-24T15:42:48.408 DEBUG:teuthology.orchestra.run.smithi204:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.i 2024-01-24T15:42:48.725 INFO:journalctl@ceph.mds.i.smithi204.stdout:Jan 24 15:42:48 smithi204 systemd[1]: Stopping Ceph mds.i for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:42:49.225 INFO:journalctl@ceph.mds.i.smithi204.stdout:Jan 24 15:42:48 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-i[76194]: 2024-01-24T15:42:48.790+0000 7f3fc2c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:42:49.225 INFO:journalctl@ceph.mds.i.smithi204.stdout:Jan 24 15:42:48 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-i[76194]: 2024-01-24T15:42:48.790+0000 7f3fc2c00700 -1 mds.i *** got signal Terminated *** 2024-01-24T15:42:51.725 INFO:journalctl@ceph.mds.i.smithi204.stdout:Jan 24 15:42:51 smithi204 bash[79210]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-i 2024-01-24T15:42:51.956 DEBUG:teuthology.orchestra.run.smithi204:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.i.service' 2024-01-24T15:42:52.033 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:42:52.034 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-01-24T15:42:52.034 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-01-24T15:42:52.034 DEBUG:teuthology.orchestra.run.smithi204:> sudo systemctl stop ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.l 2024-01-24T15:42:52.224 INFO:journalctl@ceph.mds.l.smithi204.stdout:Jan 24 15:42:52 smithi204 systemd[1]: Stopping Ceph mds.l for bede0bb6-bacd-11ee-95b1-87774f69a715... 2024-01-24T15:42:52.724 INFO:journalctl@ceph.mds.l.smithi204.stdout:Jan 24 15:42:52 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-l[75164]: 2024-01-24T15:42:52.396+0000 7f9147200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-24T15:42:52.725 INFO:journalctl@ceph.mds.l.smithi204.stdout:Jan 24 15:42:52 smithi204 ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-l[75164]: 2024-01-24T15:42:52.396+0000 7f9147200700 -1 mds.l *** got signal Terminated *** 2024-01-24T15:42:55.582 INFO:journalctl@ceph.mds.l.smithi204.stdout:Jan 24 15:42:55 smithi204 bash[79349]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715-mds-l 2024-01-24T15:42:55.834 INFO:journalctl@ceph.mds.l.smithi204.stdout:Jan 24 15:42:55 smithi204 systemd[1]: ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.l.service: Succeeded. 2024-01-24T15:42:55.834 INFO:journalctl@ceph.mds.l.smithi204.stdout:Jan 24 15:42:55 smithi204 systemd[1]: Stopped Ceph mds.l for bede0bb6-bacd-11ee-95b1-87774f69a715. 2024-01-24T15:42:55.841 DEBUG:teuthology.orchestra.run.smithi204:> sudo pkill -f 'journalctl -f -n 0 -u ceph-bede0bb6-bacd-11ee-95b1-87774f69a715@mds.l.service' 2024-01-24T15:42:55.919 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-24T15:42:55.919 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-01-24T15:42:55.919 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 --force --keep-logs 2024-01-24T15:42:56.202 INFO:teuthology.orchestra.run.smithi005.stdout:Deleting cluster with fsid: bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:42:59.117 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 --force --keep-logs 2024-01-24T15:42:59.394 INFO:teuthology.orchestra.run.smithi160.stdout:Deleting cluster with fsid: bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:43:02.309 DEBUG:teuthology.orchestra.run.smithi204:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 --force --keep-logs 2024-01-24T15:43:02.569 INFO:teuthology.orchestra.run.smithi204.stdout:Deleting cluster with fsid: bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:43:05.396 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-24T15:43:05.471 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-24T15:43:05.546 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-24T15:43:05.615 INFO:tasks.cephadm:Archiving crash dumps... 2024-01-24T15:43:05.618 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/crash to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530905/remote/smithi005/crash 2024-01-24T15:43:05.619 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/crash -- . 2024-01-24T15:43:05.698 INFO:teuthology.orchestra.run.smithi005.stderr:tar: /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/crash: Cannot open: No such file or directory 2024-01-24T15:43:05.698 INFO:teuthology.orchestra.run.smithi005.stderr:tar: Error is not recoverable: exiting now 2024-01-24T15:43:05.701 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/crash to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530905/remote/smithi160/crash 2024-01-24T15:43:05.702 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/crash -- . 2024-01-24T15:43:05.783 INFO:teuthology.orchestra.run.smithi160.stderr:tar: /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/crash: Cannot open: No such file or directory 2024-01-24T15:43:05.783 INFO:teuthology.orchestra.run.smithi160.stderr:tar: Error is not recoverable: exiting now 2024-01-24T15:43:05.786 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/crash to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530905/remote/smithi204/crash 2024-01-24T15:43:05.787 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/crash -- . 2024-01-24T15:43:05.864 INFO:teuthology.orchestra.run.smithi204.stderr:tar: /var/lib/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/crash: Cannot open: No such file or directory 2024-01-24T15:43:05.864 INFO:teuthology.orchestra.run.smithi204.stderr:tar: Error is not recoverable: exiting now 2024-01-24T15:43:05.867 INFO:tasks.cephadm:Checking cluster log for badness... 2024-01-24T15:43:05.867 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-01-24T15:43:05.942 INFO:teuthology.orchestra.run.smithi005.stderr:grep: /var/log/ceph/bede0bb6-bacd-11ee-95b1-87774f69a715/ceph.log: No such file or directory 2024-01-24T15:43:05.947 INFO:tasks.cephadm:Compressing logs... 2024-01-24T15:43:05.947 DEBUG:teuthology.orchestra.run.smithi005:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-24T15:43:05.951 DEBUG:teuthology.orchestra.run.smithi160:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-24T15:43:05.955 DEBUG:teuthology.orchestra.run.smithi204:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-24T15:43:06.012 INFO:teuthology.orchestra.run.smithi005.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-01-24T15:43:06.018 INFO:teuthology.orchestra.run.smithi160.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-01-24T15:43:06.019 INFO:teuthology.orchestra.run.smithi204.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-01-24T15:43:06.912 INFO:tasks.cephadm:Archiving logs... 2024-01-24T15:43:06.912 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530905/remote/smithi005/log 2024-01-24T15:43:06.913 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-24T15:43:07.094 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530905/remote/smithi160/log 2024-01-24T15:43:07.095 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-24T15:43:07.238 DEBUG:teuthology.misc:Transferring archived files from smithi204:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530905/remote/smithi204/log 2024-01-24T15:43:07.239 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-24T15:43:07.375 INFO:tasks.cephadm:Removing cluster... 2024-01-24T15:43:07.376 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 --force 2024-01-24T15:43:07.627 INFO:teuthology.orchestra.run.smithi005.stdout:Deleting cluster with fsid: bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:43:08.092 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 --force 2024-01-24T15:43:08.350 INFO:teuthology.orchestra.run.smithi160.stdout:Deleting cluster with fsid: bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:43:08.797 DEBUG:teuthology.orchestra.run.smithi204:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid bede0bb6-bacd-11ee-95b1-87774f69a715 --force 2024-01-24T15:43:09.056 INFO:teuthology.orchestra.run.smithi204.stdout:Deleting cluster with fsid: bede0bb6-bacd-11ee-95b1-87774f69a715 2024-01-24T15:43:09.486 INFO:tasks.cephadm:Removing cephadm ... 2024-01-24T15:43:09.487 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf /home/ubuntu/cephtest/cephadm 2024-01-24T15:43:09.533 DEBUG:teuthology.orchestra.run.smithi160:> rm -rf /home/ubuntu/cephtest/cephadm 2024-01-24T15:43:09.578 DEBUG:teuthology.orchestra.run.smithi204:> rm -rf /home/ubuntu/cephtest/cephadm 2024-01-24T15:43:09.620 INFO:tasks.cephadm:Teardown complete 2024-01-24T15:43:09.621 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks/cephadm.py", line 1714, in task with contextutil.nested( File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks/cephadm.py", line 1629, in initialize_config yield File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks/cephadm.py", line 1051, in cephfs_setup fs = Filesystem(ctx, fs_config=temp, name=name, create=True) File "/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks/cephfs/filesystem.py", line 532, in __init__ self.create() File "/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks/cephfs/filesystem.py", line 762, in create self.run_ceph_cmd('fs', 'subvolumegroup', 'create', self.name, 'qa') AttributeError: 'Filesystem' object has no attribute 'run_ceph_cmd' 2024-01-24T15:43:09.848 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=fcfe331c9d6749968d1c0e32b1bec7a3 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks/cephadm.py", line 1714, in task with contextutil.nested( File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks/cephadm.py", line 1629, in initialize_config yield File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks/cephadm.py", line 1051, in cephfs_setup fs = Filesystem(ctx, fs_config=temp, name=name, create=True) File "/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks/cephfs/filesystem.py", line 532, in __init__ self.create() File "/home/teuthworker/src/git.ceph.com_ceph-c_4e3182a65800aed6d4aa2f6b86da3cfd72188134/qa/tasks/cephfs/filesystem.py", line 762, in create self.run_ceph_cmd('fs', 'subvolumegroup', 'create', self.name, 'qa') AttributeError: 'Filesystem' object has no attribute 'run_ceph_cmd' 2024-01-24T15:43:09.851 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-01-24T15:43:09.862 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-24T15:43:09.872 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-24T15:43:09.872 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-24T15:43:09.888 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-24T15:43:09.893 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-24T15:43:10.035 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-24T15:43:10.044 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-24T15:43:10.045 DEBUG:teuthology.orchestra.run.smithi005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-24T15:43:10.049 DEBUG:teuthology.orchestra.run.smithi160:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-24T15:43:10.054 DEBUG:teuthology.orchestra.run.smithi204:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-24T15:43:10.086 INFO:teuthology.orchestra.run.smithi005.stderr:bash: ntpq: command not found 2024-01-24T15:43:10.091 INFO:teuthology.orchestra.run.smithi160.stderr:bash: ntpq: command not found 2024-01-24T15:43:10.092 INFO:teuthology.orchestra.run.smithi204.stderr:bash: ntpq: command not found 2024-01-24T15:43:10.094 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-24T15:43:10.095 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-01-24T15:43:10.095 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 49 +457us[ +457us] +/- 76ms 2024-01-24T15:43:10.095 INFO:teuthology.orchestra.run.smithi005.stdout:^* hv02.front.sepia.ceph.com 3 6 377 52 -1381us[-1389us] +/- 68ms 2024-01-24T15:43:10.095 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 +1317us[+1317us] +/- 89ms 2024-01-24T15:43:10.095 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-01-24T15:43:10.099 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-24T15:43:10.099 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2024-01-24T15:43:10.099 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 50 +498us[ +498us] +/- 76ms 2024-01-24T15:43:10.099 INFO:teuthology.orchestra.run.smithi160.stdout:^* hv02.front.sepia.ceph.com 3 6 377 51 -1358us[-1357us] +/- 68ms 2024-01-24T15:43:10.099 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 +1356us[+1356us] +/- 89ms 2024-01-24T15:43:10.099 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-01-24T15:43:10.101 INFO:teuthology.orchestra.run.smithi204.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-24T15:43:10.101 INFO:teuthology.orchestra.run.smithi204.stdout:=============================================================================== 2024-01-24T15:43:10.101 INFO:teuthology.orchestra.run.smithi204.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 52 +470us[ +469us] +/- 76ms 2024-01-24T15:43:10.101 INFO:teuthology.orchestra.run.smithi204.stdout:^* hv02.front.sepia.ceph.com 3 6 377 51 -1369us[-1370us] +/- 68ms 2024-01-24T15:43:10.101 INFO:teuthology.orchestra.run.smithi204.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 +1337us[+1337us] +/- 89ms 2024-01-24T15:43:10.102 INFO:teuthology.orchestra.run.smithi204.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-01-24T15:43:10.102 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-24T15:43:10.110 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-24T15:43:10.111 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-24T15:43:10.171 DEBUG:teuthology.orchestra.run.smithi005:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-24T15:43:10.303 DEBUG:teuthology.orchestra.run.smithi160:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-24T15:43:10.431 DEBUG:teuthology.orchestra.run.smithi204:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-24T15:43:10.557 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-24T15:43:10.627 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T15:43:10.627 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-24T15:43:10.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T15:43:10.697 DEBUG:teuthology.orchestra.run.smithi204:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-24T15:43:10.764 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T15:43:10.765 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-24T15:43:10.774 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-24T15:43:10.814 INFO:teuthology.task.internal:Duration was 1525.297825 seconds 2024-01-24T15:43:10.814 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-24T15:43:10.823 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-24T15:43:10.823 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-24T15:43:10.827 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-24T15:43:10.832 DEBUG:teuthology.orchestra.run.smithi204:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-24T15:43:10.935 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-24T15:43:10.940 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-24T15:43:10.943 INFO:teuthology.orchestra.run.smithi204.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-24T15:43:11.260 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-24T15:43:11.260 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi005.front.sepia.ceph.com 2024-01-24T15:43:11.260 DEBUG:teuthology.orchestra.run.smithi005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-24T15:43:11.317 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi160.front.sepia.ceph.com 2024-01-24T15:43:11.317 DEBUG:teuthology.orchestra.run.smithi160:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-24T15:43:11.374 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi204.front.sepia.ceph.com 2024-01-24T15:43:11.374 DEBUG:teuthology.orchestra.run.smithi204:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-24T15:43:11.431 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-24T15:43:11.431 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-24T15:43:11.435 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-24T15:43:11.440 DEBUG:teuthology.orchestra.run.smithi204:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-24T15:43:11.530 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-24T15:43:11.530 DEBUG:teuthology.orchestra.run.smithi005:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-24T15:43:11.534 DEBUG:teuthology.orchestra.run.smithi160:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-24T15:43:11.538 DEBUG:teuthology.orchestra.run.smithi204:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-24T15:43:11.699 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-24T15:43:11.709 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-24T15:43:11.709 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-24T15:43:11.775 DEBUG:teuthology.orchestra.run.smithi160:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-24T15:43:11.840 DEBUG:teuthology.orchestra.run.smithi204:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-24T15:43:11.905 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-24T15:43:11.915 DEBUG:teuthology.orchestra.run.smithi005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-24T15:43:11.920 DEBUG:teuthology.orchestra.run.smithi160:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-24T15:43:11.924 DEBUG:teuthology.orchestra.run.smithi204:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-24T15:43:11.980 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = core 2024-01-24T15:43:11.984 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = core 2024-01-24T15:43:11.987 INFO:teuthology.orchestra.run.smithi204.stdout:kernel.core_pattern = core 2024-01-24T15:43:12.036 DEBUG:teuthology.orchestra.run.smithi005:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-24T15:43:12.075 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T15:43:12.075 DEBUG:teuthology.orchestra.run.smithi160:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-24T15:43:12.114 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T15:43:12.115 DEBUG:teuthology.orchestra.run.smithi204:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-24T15:43:12.154 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-24T15:43:12.156 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-24T15:43:12.166 INFO:teuthology.task.internal:Transferring archived files... 2024-01-24T15:43:12.167 DEBUG:teuthology.misc:Transferring archived files from smithi005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530905/remote/smithi005 2024-01-24T15:43:12.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-24T15:43:12.244 DEBUG:teuthology.misc:Transferring archived files from smithi160:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530905/remote/smithi160 2024-01-24T15:43:12.244 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-24T15:43:12.321 DEBUG:teuthology.misc:Transferring archived files from smithi204:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530905/remote/smithi204 2024-01-24T15:43:12.321 DEBUG:teuthology.orchestra.run.smithi204:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-24T15:43:12.396 INFO:teuthology.task.internal:Removing archive directory... 2024-01-24T15:43:12.396 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-24T15:43:12.400 DEBUG:teuthology.orchestra.run.smithi160:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-24T15:43:12.404 DEBUG:teuthology.orchestra.run.smithi204:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-24T15:43:12.445 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-24T15:43:12.456 INFO:teuthology.task.internal:Not uploading archives. 2024-01-24T15:43:12.456 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-24T15:43:12.464 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-24T15:43:12.465 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-24T15:43:12.481 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-24T15:43:12.486 DEBUG:teuthology.orchestra.run.smithi204:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-24T15:43:12.518 INFO:teuthology.orchestra.run.smithi005.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 24 15:43 /home/ubuntu/cephtest 2024-01-24T15:43:12.523 INFO:teuthology.orchestra.run.smithi160.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 24 15:43 /home/ubuntu/cephtest 2024-01-24T15:43:12.527 INFO:teuthology.orchestra.run.smithi204.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 24 15:43 /home/ubuntu/cephtest 2024-01-24T15:43:12.531 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-24T15:43:12.543 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-24T15:43:12.563 INFO:teuthology.nuke:Checking targets against current locks 2024-01-24T15:43:12.590 DEBUG:teuthology.nuke:shortname: smithi005 2024-01-24T15:43:12.590 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-24T15:43:12.616 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530905', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 15:05:38.985061', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFnYjpS9mzlWrQJB5X9LUdt6fHFWI0Wqr4xnsFeYiawvFhmFwzwv3ALfolLmPaXjcIubJfSMygtgHzLtUKmHfbc='} 2024-01-24T15:43:12.620 DEBUG:teuthology.nuke:shortname: smithi160 2024-01-24T15:43:12.621 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-24T15:43:12.646 DEBUG:teuthology.nuke:shortname: smithi204 2024-01-24T15:43:12.646 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-24T15:43:12.650 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530905', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 15:05:38.981839', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHS9eeKoAXq4RAOQUASjdxz1mWjwX51DLEPSv41PitnHqeNFaUUHlJo+2FqmsazRwxn1hBVXhrJnNOYRXx5Aefo='} 2024-01-24T15:43:12.672 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-24_12:12:30-fs-wip-vshankar-testing1-reef-2024-01-24-1150-testing-default-smithi/7530905', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 15:05:38.983726', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDWmqv2IpSh/vSoK0ySHtqk8o1weSlsIjAPa+Lq4Xy6lUK+TVU0R7QFvxLwN+7mm0NdfwcV+/umoZWMCkgq+QBw='} 2024-01-24T15:43:12.685 INFO:teuthology.orchestra.console.smithi005:Power off 2024-01-24T15:43:12.685 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-24T15:43:12.709 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2024-01-24T15:43:12.709 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T15:43:12.724 INFO:teuthology.orchestra.console.smithi160:Power off 2024-01-24T15:43:12.725 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-24T15:43:12.739 INFO:teuthology.orchestra.console.smithi204:Power off 2024-01-24T15:43:12.740 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-24T15:43:12.747 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-01-24T15:43:12.748 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off 2024-01-24T15:43:12.751 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T15:43:12.762 DEBUG:teuthology.orchestra.console.smithi204:power off output: Chassis Power Control: Down/Off 2024-01-24T15:43:12.763 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T15:43:12.777 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2024-01-24T15:43:12.785 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2024-01-24T15:43:16.748 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T15:43:16.779 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T15:43:16.786 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T15:43:16.860 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-01-24T15:43:16.888 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2024-01-24T15:43:16.896 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2024-01-24T15:43:20.864 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T15:43:20.889 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T15:43:20.898 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T15:43:20.975 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-01-24T15:43:21.000 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2024-01-24T15:43:21.008 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2024-01-24T15:43:21.076 INFO:teuthology.orchestra.console.smithi005:Power off completed 2024-01-24T15:43:21.101 INFO:teuthology.orchestra.console.smithi160:Power off completed 2024-01-24T15:43:25.012 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-24T15:43:25.121 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2024-01-24T15:43:25.222 INFO:teuthology.orchestra.console.smithi204:Power off completed 2024-01-24T15:43:25.328 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/iozone}} duration: 1525.2978253364563 failure_reason: '''Filesystem'' object has no attribute ''run_ceph_cmd''' flavor: default mon.a-kernel-sha1: f2d3460408951339ac0933340ad449487c9efddc mon.b-kernel-sha1: f2d3460408951339ac0933340ad449487c9efddc mon.c-kernel-sha1: f2d3460408951339ac0933340ad449487c9efddc owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=fcfe331c9d6749968d1c0e32b1bec7a3 status: fail success: false 2024-01-24T15:43:25.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-24T15:43:25.411 INFO:teuthology.run:FAIL